00010000:00010000:3.0:1769074908.148912:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.148928:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.148935:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.148940:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149007:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149015:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149022:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149029:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044754800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.149033:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149040:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149067:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.149071:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.149076:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149082:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149100:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149106:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149112:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149116:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.149119:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149124:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149131:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5b6910bc (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.149133:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.149136:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149141:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.149173:0:7533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f28 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2791d expref: 278 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.149182:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.149185:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074908.149188:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2791d expref: 278 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.149199:0:7533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a37800, rc -2) 00000100:00100000:3.0:1769074908.149293:0:7533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2418:x1855007615911552:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 597us (1005us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074908.149313:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2328 00000100:00100000:3.0:1769074908.188241:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615911680 00000100:00100000:3.0:1769074908.188256:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615911680 00000100:00100000:3.0:1769074908.188342:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8780 00000100:00100000:3.0:1769074908.188355:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66682:x1855007615911680:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074908.188384:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.188427:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27955 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.188577:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.188604:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188618:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188637:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.188645:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188651:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188729:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188737:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188744:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188752:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188759:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044754800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.188763:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188771:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188785:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.188788:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.188794:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188800:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188818:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188824:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188830:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188835:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a37800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.188838:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188847:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188854:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfa91d056 (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.188856:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.188859:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188864:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.188901:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f3d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27955 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.188911:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.188913:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.188917:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27955 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.188927:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755200, rc 0) 00000100:00100000:3.0:1769074908.189012:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66682:x1855007615911680:12345-192.168.204.32@tcp:101:bash.0 Request processed in 659us (899us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074908.189020:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8780 00000100:00100000:3.0:1769074908.223325:0:7533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615911936 00000100:00100000:3.0:1769074908.223332:0:7533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615911936 00000100:00100000:3.0:1769074908.223375:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2329 00000100:00100000:3.0:1769074908.223383:0:7533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007615911936:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074908.223410:0:7533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.223424:0:7533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f67 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27963 expref: -99 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.223472:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.223482:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223491:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223506:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.223512:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223519:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223576:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223585:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223591:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223596:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.223599:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223606:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223615:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.223617:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.223620:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223625:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223637:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223642:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223647:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223652:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044754800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.223656:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223661:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223668:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d4da12 (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.223670:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.223673:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223678:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f75 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.223700:0:7533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f67 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27963 expref: 278 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.223708:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.223710:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074908.223713:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f67 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27963 expref: 278 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.223721:0:7533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a37800, rc -2) 00000100:00100000:3.0:1769074908.223767:0:7533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007615911936:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 385us (1376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074908.223774:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2329 00000100:00100000:3.0:1769074908.240001:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615912064 00000100:00100000:3.0:1769074908.240015:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615912064 00000100:00100000:3.0:1769074908.240152:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8782 00000100:00100000:3.0:1769074908.240164:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:66683:x1855007615912064:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074908.240194:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.240222:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f7c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2796a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.240334:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.240352:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240366:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240386:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.240399:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240406:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240501:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240510:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240517:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240523:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240578:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.240584:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240593:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240608:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.240613:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.240619:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240626:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240644:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240651:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240657:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240662:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a37800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.240664:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240669:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240676:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfa91d056 (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.240679:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.240681:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240687:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f8a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.240724:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f7c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2796a expref: 278 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.240734:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.240736:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.240740:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2796a expref: 278 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.240751:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044754800, rc 0) 00000100:00100000:3.0:1769074908.240826:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:66683:x1855007615912064:12345-192.168.204.32@tcp:101:rm.0 Request processed in 664us (961us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074908.240836:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8782 00000100:00100000:3.0:1769074908.277794:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615912192 00000100:00100000:3.0:1769074908.277808:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615912192 00000100:00100000:3.0:1769074908.278011:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8783 00000100:00100000:3.0:1769074908.278022:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:66684:x1855007615912192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074908.278058:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.278085:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f91 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27971 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.278180:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.278196:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278207:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278222:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.278229:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278234:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278316:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278324:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278332:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278338:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278345:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044754800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.278349:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278357:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278371:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.278374:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.278379:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278384:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044754800/0x557988ac98fe4f98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278400:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278405:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278411:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278426:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.278429:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278468:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278476:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfa91d056 (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.278478:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.278481:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278486:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755200/0x557988ac98fe4f9f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfa91d056 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.278524:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f91 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27971 expref: 278 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.278798:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.278801:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.278806:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe4f91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27971 expref: 278 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.278817:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a37800, rc 0) 00000100:00100000:3.0:1769074908.294762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.304643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.310796:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.390786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.422214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.429801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.461524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.470403:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615914368 00000100:00100000:3.0:1769074908.470425:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615914368 00000100:00100000:3.0:1769074908.470520:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8791 00000100:00100000:3.0:1769074908.470568:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:66691:x1855007615914368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074908.470607:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.470634:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe507f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e279f6 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.470792:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.470812:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.470826:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.470842:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe508d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xcae582b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.471146:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe508d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcae582b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.471156:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe508d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcae582b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:3.0:1769074908.473623:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x81:0x0], index 1: 0 00010000:00010000:3.0:1769074908.473866:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe5094 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.473884:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe5094 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473896:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe5094 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473940:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473947:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473952:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473959:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473964:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.473969:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473976:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.473987:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.473991:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.473996:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.474002:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe5086 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:3.0:1769074908.474017:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c75d94f1 reply state 00000000515480f4 transno 4294968815 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe508d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcae582b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.474029:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe508d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcae582b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.474035:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcae582b6 (ffff916052b6fe00) 00010000:00010000:3.0:1769074908.474039:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074908.474041:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074908.474079:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe507f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279f6 expref: 284 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.474094:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a37800/0x557988ac98fe5094 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279f6 expref: 283 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.474101:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x10b:0x0].0x0 (ffff916052b6fa00) 00010000:00010000:3.0:1769074908.474103:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074908.474105:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a37800, rc 0) 00000100:00100000:3.0:1769074908.474188:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:66691:x1855007615914368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3659us (3903us total) trans 4294968815 rc 0/0 00000100:00100000:3.0:1769074908.474197:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8791 00000100:00100000:3.0:1769074908.483076:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615914496 00000100:00100000:3.0:1769074908.483086:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615914496 00000100:00100000:3.0:1769074908.483153:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2503 00000100:00100000:3.0:1769074908.483162:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+106:2420:x1855007615914496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074908.483180:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.483222:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e279fd expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074908.483244:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074908.483263:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074908.483265:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074908.483273:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279fd expref: 107 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074908.483290:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279fd expref: 107 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074908.483305:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755200, rc 0) 00000100:00100000:3.0:1769074908.483373:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+107:2420:x1855007615914496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074908.483381:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2503 00000100:00100000:3.0:1769074908.514007:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615914624 00000100:00100000:3.0:1769074908.514024:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615914624 00000100:00100000:3.0:1769074908.514105:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2504 00000100:00100000:3.0:1769074908.514116:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+107:66691:x1855007615914624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074908.514135:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.514156:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044754800/0x557988ac98fe50a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27a04 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.514190:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279fd expref: 108 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074908.514199:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074908.514201:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074908.514205:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044754800/0x557988ac98fe50a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a04 expref: 108 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.514242:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279fd expref: 108 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074908.514257:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916044755200/0x557988ac98fe50a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e279fd expref: 108 pid: 8625 timeout: 1997 lvb_type: 1 00000100:00100000:3.0:1769074908.514277:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626588544:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074908.514400:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074908.517212:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626588544:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074908.517249:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044754800/0x557988ac98fe50a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x81:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a04 expref: 108 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.517269:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044754800, rc 0) 00000100:00100000:3.0:1769074908.517336:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+108:66691:x1855007615914624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3221us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074908.517346:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2504 00000100:00100000:3.0:1769074908.574999:0:7533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615915136 00000100:00100000:3.0:1769074908.575019:0:7533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615915136 00000100:00100000:3.0:1769074908.575114:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2332 00000100:00100000:3.0:1769074908.575127:0:7533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:2418:x1855007615915136:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074908.575223:0:7533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.575253:0:7533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe50b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27a0b expref: -99 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.575349:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.575369:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575382:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575404:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.575410:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575416:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575687:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575697:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575704:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575711:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.575715:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575724:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575739:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.575743:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.575751:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575757:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe50b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575772:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575779:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575785:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575789:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.575792:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575797:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575804:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x42afda00 (ffff916174a68d00) 00010000:00010000:3.0:1769074908.575807:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.575810:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575815:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x42afda00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.575874:0:7533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe50b0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a0b expref: 286 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.575885:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.575887:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074908.575891:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe50b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a0b expref: 286 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.575901:0:7533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8bc00, rc -2) 00000100:00100000:3.0:1769074908.576004:0:7533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:2418:x1855007615915136:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 880us (1225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074908.576014:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2332 00000100:00100000:3.0:1769074908.614231:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615915264 00000100:00100000:3.0:1769074908.614245:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615915264 00000100:00100000:3.0:1769074908.614329:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8792 00000100:00100000:3.0:1769074908.614340:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66697:x1855007615915264:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074908.614368:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.614397:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27a43 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.614508:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.614527:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614593:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614610:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.614617:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614625:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614695:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614703:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614710:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614716:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614721:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.614725:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614733:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614747:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.614750:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.614756:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614761:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe50cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614800:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614806:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614824:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614829:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.614832:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.614841:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.615311:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1376a683 (ffff916174a68d00) 00010000:00010000:3.0:1769074908.615314:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.615318:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.615323:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe50d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1376a683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.615389:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50c5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a43 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.615400:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.615402:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.615406:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe50c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a43 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.615421:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7a00, rc 0) 00000100:00100000:3.0:1769074908.616190:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66697:x1855007615915264:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1846us (2557us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074908.616198:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8792 00000100:00100000:3.0:1769074908.652804:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615915392 00000100:00100000:3.0:1769074908.652827:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615915392 00000100:00100000:3.0:1769074908.728177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.798105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.801665:0:7533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615917184 00000100:00100000:3.0:1769074908.801675:0:7533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615917184 00000100:00100000:3.0:1769074908.801728:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2334 00000100:00100000:3.0:1769074908.801737:0:7533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:2417:x1855007615917184:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074908.801768:0:7533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.801786:0:7533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe519e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27a90 expref: -99 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.801839:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.801853:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801864:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801878:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074908.801885:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801891:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801942:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801949:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801956:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801962:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.801967:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801973:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801984:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.801987:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.801992:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.801998:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802029:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802035:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802040:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802045:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.802049:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802054:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802061:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7fa4735 (ffff916174a68d00) 00010000:00010000:3.0:1769074908.802063:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.802066:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802075:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074908.802113:0:7533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe519e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a90 expref: 290 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.802122:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.802125:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074908.802128:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe519e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a90 expref: 290 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.802138:0:7533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7a00, rc -2) 00000100:00100000:3.0:1769074908.802255:0:7533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:2417:x1855007615917184:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 519us (834us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074908.802264:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2334 00000100:00100000:3.0:1769074908.829501:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615917440 00000100:00100000:3.0:1769074908.829512:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615917440 00000100:00100000:3.0:1769074908.829615:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8801 00000100:00100000:3.0:1769074908.829626:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:66704:x1855007615917440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074908.829646:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074908.829667:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe51c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27a9e expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.829723:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.829735:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829745:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829754:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074908.829758:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829762:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829804:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829808:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829812:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829816:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829820:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.829822:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829827:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829835:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.829837:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.829841:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829845:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe51cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829868:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829872:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829875:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829878:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074908.829880:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829883:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829886:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5b6910bc (ffff916174a68d00) 00010000:00010000:3.0:1769074908.829887:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.829889:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829892:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe51d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5b6910bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074908.829926:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe51c8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a9e expref: 290 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.829932:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074908.829934:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074908.829937:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7a00/0x557988ac98fe51c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27a9e expref: 290 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074908.829944:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7a00, rc 0) 00000100:00100000:3.0:1769074908.830008:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:66704:x1855007615917440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 384us (689us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074908.830015:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8801 00000100:00100000:3.0:1769074908.858446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.868394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.877506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.877580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.877622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074908.879241:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074908.919658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074908.992771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074909.004062:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074909.015270:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615920000 00000100:00100000:3.0:1769074909.015280:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615920000 00000100:00100000:3.0:1769074909.015346:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2509 00000100:00100000:3.0:1769074909.015356:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+109:2419:x1855007615920000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.015375:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.015396:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27af2 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074909.015419:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074909.015620:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.015622:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.015632:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af2 expref: 110 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.015647:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af2 expref: 110 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.015659:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6000, rc 0) 00000100:00100000:3.0:1769074909.016144:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+110:2419:x1855007615920000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 787us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074909.016152:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2509 00000100:00100000:3.0:1769074909.024875:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615920128 00000100:00100000:3.0:1769074909.024886:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615920128 00000100:00100000:3.0:1769074909.024986:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2510 00000100:00100000:3.0:1769074909.024997:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+110:66710:x1855007615920128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.025016:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.025046:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9160449a7a00/0x557988ac98fe52cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27af9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.025076:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af2 expref: 111 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.025085:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.025088:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.025092:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9160449a7a00/0x557988ac98fe52cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af9 expref: 111 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.025128:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af2 expref: 111 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.025150:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9160449a6000/0x557988ac98fe52c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af2 expref: 111 pid: 8404 timeout: 1998 lvb_type: 1 00000100:00100000:3.0:1769074909.025164:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1855007626589312:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074909.025276:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074909.030123:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1855007626589312:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074909.030154:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9160449a7a00/0x557988ac98fe52cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27af9 expref: 111 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.030172:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7a00, rc 0) 00000100:00100000:3.0:1769074909.030233:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+111:66710:x1855007615920128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5238us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074909.030241:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2510 00000100:00100000:3.0:1769074909.108260:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1769074909.108284:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626589568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1769074909.108349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1769074909.109044:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074909.109078:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626589568:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1769074909.111465:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074909.177792:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615921792 00000100:00100000:3.0:1769074909.177801:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615921792 00000100:00100000:3.0:1769074909.177861:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2511 00000100:00100000:3.0:1769074909.177870:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+108:2418:x1855007615921792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.177888:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.177907:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27b69 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074909.177926:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074909.177941:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.177943:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.177949:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b69 expref: 109 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.177962:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b69 expref: 109 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.177971:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7800, rc 0) 00000100:00100000:3.0:1769074909.178019:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+109:2418:x1855007615921792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 150us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074909.178025:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2511 00000100:00100000:3.0:1769074909.183812:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615921920 00000100:00100000:3.0:1769074909.183824:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615921920 00000100:00100000:3.0:1769074909.183936:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2512 00000100:00100000:3.0:1769074909.183947:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+109:66717:x1855007615921920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.183965:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.183983:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a7200/0x557988ac98fe538f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27b70 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.184014:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b69 expref: 110 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.184023:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.184046:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.184050:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a7200/0x557988ac98fe538f lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b70 expref: 110 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.184087:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b69 expref: 110 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.184102:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe5388 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27b69 expref: 110 pid: 8404 timeout: 1998 lvb_type: 1 00000100:00100000:3.0:1769074909.184115:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626589696:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074909.184228:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074909.188779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.196595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.266705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.353988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.362834:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615923584 00000100:00100000:3.0:1769074909.362845:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615923584 00000100:00100000:3.0:1769074909.362915:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2514 00000100:00100000:3.0:1769074909.362924:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+111:66723:x1855007615923584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.362940:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.362957:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9160449a7c00/0x557988ac98fe543e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27baf expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.362988:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91615db8c200/0x557988ac98fe5437 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ba8 expref: 112 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.362995:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.362998:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.363003:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9160449a7c00/0x557988ac98fe543e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27baf expref: 112 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.363038:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91615db8c200/0x557988ac98fe5437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ba8 expref: 112 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.363051:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91615db8c200/0x557988ac98fe5437 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ba8 expref: 112 pid: 8404 timeout: 1998 lvb_type: 1 00000100:00100000:3.0:1769074909.363064:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1855007626589952:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074909.363174:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a180 going to sleep for 11 seconds 00010000:00010000:3.0:1769074909.376000:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91615db8c200/0x557988ac98fe5437 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ba8 expref: 113 pid: 8404 timeout: 1998 lvb_type: 1 00000100:00100000:3.0:1769074909.376016:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1855007626589952:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074909.376111:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9160449a7c00/0x557988ac98fe543e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27baf expref: 112 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.376124:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7c00, rc 0) 00000100:00100000:3.0:1769074909.376210:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+112:66723:x1855007615923584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 13286us (13539us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074909.376219:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2514 00000100:00100000:3.0:1769074909.451806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.453031:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181075c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2418:x1855007615924096:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 939us (1225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074909.453041:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2339 00000100:00100000:3.0:1769074909.522444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.559043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.570632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.579308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.589731:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.643115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.729069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.729130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.737285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.754500:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.759116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.765212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.772903:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.862672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.862738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.873243:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615928192 00000100:00100000:3.0:1769074909.873256:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615928192 00000100:00100000:3.0:1769074909.873320:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8836 00000100:00100000:3.0:1769074909.873330:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:66743:x1855007615928192:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074909.873352:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.873374:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5621 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27d22 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.873458:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074909.873474:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873485:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873509:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074909.873516:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873522:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873765:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873773:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873779:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873785:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074909.873789:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873796:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873808:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074909.873811:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074909.873815:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873821:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5628 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873846:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873853:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873858:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873863:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074909.873866:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873872:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873878:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8ca5d38 (ffff91604ecb7800) 00010000:00010000:3.0:1769074909.873881:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074909.873883:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873889:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe562f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8ca5d38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074909.873921:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5621 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d22 expref: 222 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.873930:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074909.873932:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074909.873935:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5621 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d22 expref: 222 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.873944:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074909.874000:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:66743:x1855007615928192:12345-192.168.204.32@tcp:101:rm.0 Request processed in 671us (982us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074909.874009:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8836 00000100:00100000:3.0:1769074909.899045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.899098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074909.929065:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615929088 00000100:00100000:3.0:1769074909.929074:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615929088 00000100:00100000:3.0:1769074909.929128:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2520 00000100:00100000:3.0:1769074909.929137:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+111:66746:x1855007615929088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074909.929154:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074909.929171:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a6800/0x557988ac98fe569f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27d7d expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.929199:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916042d42200/0x557988ac98fe5698 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d76 expref: 112 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.929207:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.929209:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074909.929213:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a6800/0x557988ac98fe569f lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d7d expref: 112 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.929246:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916042d42200/0x557988ac98fe5698 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d76 expref: 112 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074909.929261:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916042d42200/0x557988ac98fe5698 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d76 expref: 112 pid: 8625 timeout: 1999 lvb_type: 1 00000100:00100000:3.0:1769074909.929274:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f922300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626590720:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074909.929378:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a180 going to sleep for 11 seconds 00000100:00100000:3.0:1769074909.951073:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f922300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626590720:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074909.951115:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9160449a6800/0x557988ac98fe569f lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d7d expref: 112 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074909.951138:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6800, rc 0) 00000100:00100000:3.0:1769074909.951210:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+112:66746:x1855007615929088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 22073us (22244us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074909.951220:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2520 00000100:00100000:3.0:1769074909.965112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.026373:0:7533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615929600 00000100:00100000:3.0:1769074910.026385:0:7533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615929600 00000100:00100000:3.0:1769074910.026465:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2346 00000100:00100000:3.0:1769074910.026481:0:7533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007615929600:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074910.026596:0:7533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.026618:0:7533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27d84 expref: -99 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.026679:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074910.026694:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026718:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026734:0:7533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7533 initiator: MDT0 00010000:00010000:3.0:1769074910.026745:0:7533:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026752:0:7533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026802:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026809:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026816:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026822:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.026826:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026833:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026846:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.026849:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.026854:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026860:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe56ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026889:0:7533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026895:0:7533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026902:0:7533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026906:0:7533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.026909:0:7533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026915:0:7533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026922:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6301b9a4 (ffff91604ecb7800) 00010000:00010000:3.0:1769074910.026924:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.026927:0:7533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026932:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe56b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7533 initiator: MDT1 00010000:00010000:3.0:1769074910.026960:0:7533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56a6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d84 expref: 226 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.026970:0:7533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.026972:0:7533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074910.026976:0:7533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27d84 expref: 226 pid: 7533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.026986:0:7533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc -2) 00000100:00100000:3.0:1769074910.027047:0:7533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007615929600:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 567us (787us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074910.027054:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2346 00000100:00100000:3.0:1769074910.074341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.099796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.099844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.114824:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615930112 00000100:00100000:3.0:1769074910.114835:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615930112 00000100:00100000:3.0:1769074910.114903:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8842 00000100:00100000:3.0:1769074910.114916:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66755:x1855007615930112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074910.114940:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.114960:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27e02 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.115253:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.115269:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115279:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115298:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.115305:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115310:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115366:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115373:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115381:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115386:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.115389:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115396:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115417:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.115421:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.115425:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115431:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5701 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115457:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115463:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115468:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115473:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.115475:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115481:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115493:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe09d3a7 (ffff91604ecb7800) 00010000:00010000:3.0:1769074910.115495:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.115498:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115502:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5708 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.115667:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56fa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e02 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.115678:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.115680:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.115684:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe56fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e02 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.115695:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.115932:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66755:x1855007615930112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1020us (1206us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.115940:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8842 00000100:00100000:3.0:1769074910.149392:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615930240 00000100:00100000:3.0:1769074910.149412:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615930240 00000100:00100000:3.0:1769074910.149469:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8843 00000100:00100000:3.0:1769074910.149478:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66758:x1855007615930240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.149507:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.149571:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe570f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27e09 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.149644:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.149657:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149667:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149680:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.149685:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149691:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149738:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149745:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149751:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149756:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.149760:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149766:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149781:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.149785:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.149790:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149796:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5716 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149821:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149827:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149832:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149837:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.149840:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149845:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149852:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe09d3a7 (ffff91604ecb7800) 00010000:00010000:3.0:1769074910.149854:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.149857:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149862:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe571d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.149892:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe570f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e09 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.149902:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.149904:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.149909:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe570f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e09 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.149919:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.149986:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66758:x1855007615930240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 508us (747us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.149993:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8843 00000100:00100000:3.0:1769074910.162056:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615930496 00000100:00100000:3.0:1769074910.162066:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615930496 00000100:00100000:3.0:1769074910.162124:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8844 00000100:00100000:3.0:1769074910.162133:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66758:x1855007615930496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.162155:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.162176:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5739 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27e48 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.162255:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.162270:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162281:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162294:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074910.162306:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162312:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162360:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162366:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162372:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162378:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.162382:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162389:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162415:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.162419:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.162424:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162430:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5740 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162456:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162462:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162468:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162472:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.162475:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162496:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162504:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe09d3a7 (ffff91604ecb7800) 00010000:00010000:3.0:1769074910.162507:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.162509:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162514:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7800/0x557988ac98fe5747 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe09d3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074910.162867:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5739 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e48 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.162879:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.162882:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.162886:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5739 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e48 expref: 226 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.162899:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.162967:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:66758:x1855007615930496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 834us (1010us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.162975:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8844 00000100:00100000:3.0:1769074910.203594:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615930880 00000100:00100000:3.0:1769074910.203604:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615930880 00000100:00100000:3.0:1769074910.203667:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2521 00000100:00100000:3.0:1769074910.203677:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+112:2420:x1855007615930880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.203694:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.203714:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9160449a7e00/0x557988ac98fe5771 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27e56 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074910.203737:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074910.203755:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.203757:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.203766:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9160449a7e00/0x557988ac98fe5771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e56 expref: 113 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074910.203782:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9160449a7e00/0x557988ac98fe5771 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27e56 expref: 113 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074910.203795:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.203846:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+113:2420:x1855007615930880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 171us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074910.203854:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2521 00000100:00100000:3.0:1769074910.227451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.262271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.306130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.306182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.319726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.350902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.371435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.383046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.394240:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615932800 00000100:00100000:3.0:1769074910.394250:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615932800 00000100:00100000:3.0:1769074910.394304:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2524 00000100:00100000:3.0:1769074910.394314:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+112:66767:x1855007615932800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.394331:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.394348:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe583c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27ed4 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.394379:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916042d43200/0x557988ac98fe5835 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ecd expref: 113 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074910.394388:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.394390:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.394394:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe583c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ed4 expref: 113 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.394442:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916042d43200/0x557988ac98fe5835 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ecd expref: 113 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074910.394456:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916042d43200/0x557988ac98fe5835 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ecd expref: 113 pid: 8625 timeout: 1999 lvb_type: 1 00000100:00100000:3.0:1769074910.394469:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626591232:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074910.394679:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a480 going to sleep for 11 seconds 00010000:00010000:3.0:1769074910.408174:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916042d43200/0x557988ac98fe5835 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ecd expref: 114 pid: 8625 timeout: 1999 lvb_type: 1 00000100:00100000:3.0:1769074910.409096:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1855007626591232:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074910.409130:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9160449a7800/0x557988ac98fe583c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ed4 expref: 113 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.409146:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7800, rc 0) 00000100:00100000:3.0:1769074910.426597:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615933184 00000100:00100000:3.0:1769074910.426608:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615933184 00000100:00100000:3.0:1769074910.426673:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1776 00000100:00100000:3.0:1769074910.426683:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181000050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:66767:x1855007615933184:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074910.427104:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181000050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:66767:x1855007615933184:12345-192.168.204.32@tcp:35:cp.0 Request processed in 420us (862us total) trans 4294968837 rc 0/0 00000100:00100000:3.0:1769074910.427112:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1776 00000100:00100000:3.0:1769074910.554744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.554821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.560074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.598956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.627992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.650140:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626591616 00000100:00100000:3.0:1769074910.650147:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626591616 00000100:00100000:3.0:1769074910.650185:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1769074910.650192:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626591616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074910.650211:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 57344 granted 484938432 pending 0 free 3915657216 avail 3684134912 00000100:00100000:3.0:1769074910.650255:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626591616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (6350us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074910.650264:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1769074910.650308:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626591616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074910.804253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.812178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074910.814989:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615935744 00000100:00100000:3.0:1769074910.814998:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615935744 00000100:00100000:3.0:1769074910.815080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8860 00000100:00100000:3.0:1769074910.815090:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66782:x1855007615935744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074910.815107:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.815126:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5970 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27fd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.815189:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.815203:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815214:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815229:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.815235:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815240:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815288:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815295:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815301:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815306:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815312:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.815315:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815321:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815332:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.815335:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.815339:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815344:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5977 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815368:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815374:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815379:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815384:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.815387:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815402:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815409:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6301b9a4 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074910.815411:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.815414:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815420:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe597e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.815448:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5970 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fd7 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.815476:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.815479:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.815483:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5970 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fd7 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.815499:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6000, rc 0) 00000100:00100000:3.0:1769074910.815593:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66782:x1855007615935744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 503us (1081us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.815600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8860 00000100:00100000:3.0:1769074910.843897:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615935872 00000100:00100000:3.0:1769074910.843913:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615935872 00000100:00100000:3.0:1769074910.843994:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8861 00000100:00100000:3.0:1769074910.844015:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66783:x1855007615935872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.844049:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.844076:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5985 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27fde expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.844167:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.844186:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844199:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844215:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.844223:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844230:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844301:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844309:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844315:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844321:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844328:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.844333:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844341:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844355:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.844359:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.844365:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844372:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe598c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844387:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844423:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844429:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844434:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.844438:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844444:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844451:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6301b9a4 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074910.844454:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.844457:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844468:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5993 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.844787:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5985 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fde expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.844801:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.844804:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.844808:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5985 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fde expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.844820:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a37e00, rc 0) 00000100:00100000:3.0:1769074910.844909:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66783:x1855007615935872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 896us (1255us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.844918:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8861 00000100:00100000:3.0:1769074910.848857:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615936000 00000100:00100000:3.0:1769074910.848873:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615936000 00000100:00100000:3.0:1769074910.848957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8862 00000100:00100000:3.0:1769074910.848969:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66783:x1855007615936000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.848996:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.849027:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe599a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e27fe5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.849119:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.849138:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849153:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849170:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.849176:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849182:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849257:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849266:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849273:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849281:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849288:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.849294:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849303:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849317:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.849321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.849327:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849333:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849375:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849382:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849388:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849405:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.849408:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849414:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849421:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6301b9a4 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074910.849424:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.849427:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849433:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59a8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6301b9a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.849502:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe599a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fe5 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.849513:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.849517:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.849521:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe599a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27fe5 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.849571:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074910.849654:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:66783:x1855007615936000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 686us (1445us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.849662:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8862 00000100:00100000:3.0:1769074910.866484:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615936384 00000100:00100000:3.0:1769074910.866499:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615936384 00000100:00100000:3.0:1769074910.872830:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615936512 00000100:00100000:3.0:1769074910.872847:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615936512 00000100:00100000:3.0:1769074910.878199:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615936640 00000100:00100000:3.0:1769074910.878212:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615936640 00010000:00010000:3.0:1769074910.878285:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98fe59d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ff3 expref: 115 pid: 25313 timeout: 2000 lvb_type: 1 00000100:00100000:3.0:1769074910.878337:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1793 00000100:00100000:3.0:1769074910.878348:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+115:2420:x1855007615936640:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074910.878366:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074910.878402:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98fe59d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ff3 expref: 115 pid: 25313 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074910.878420:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98fe59d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ff3 expref: 115 pid: 25313 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074910.878453:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.878455:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.878464:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4600/0x557988ac98fe59d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ffa expref: 115 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.878475:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4600/0x557988ac98fe59d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ffa expref: 115 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.878745:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4600/0x557988ac98fe59d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e27ffa expref: 115 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074910.878764:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626593920:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074910.878871:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a480 going to sleep for 11 seconds 00000100:00100000:3.0:1769074910.887436:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615936896 00000100:00100000:3.0:1769074910.887451:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615936896 00000100:00100000:3.0:1769074910.887683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1778 00000100:00100000:3.0:1769074910.887696:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:66783:x1855007615936896:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074910.888182:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:66783:x1855007615936896:12345-192.168.204.32@tcp:35:cp.0 Request processed in 487us (861us total) trans 4294968841 rc 0/0 00000100:00100000:3.0:1769074910.888191:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1778 00000100:00100000:3.0:1769074910.927159:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615937024 00000100:00100000:3.0:1769074910.927174:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615937024 00000100:00100000:3.0:1769074910.927251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8864 00000100:00100000:3.0:1769074910.927263:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66787:x1855007615937024:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074910.927289:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.927315:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28001 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.927443:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.927462:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927476:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927502:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074910.927511:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927518:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927748:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927757:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927764:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927770:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927777:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.927782:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927791:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927810:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.927813:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.927819:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe59e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927861:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927867:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927872:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927877:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.927880:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927885:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927892:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x60af6a1e (ffff91604ecb7b00) 00010000:00010000:3.0:1769074910.927894:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.927897:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927903:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074910.927959:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59e0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28001 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.927971:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.927974:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.927978:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28001 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.927989:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.942366:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615937280 00000100:00100000:3.0:1769074910.942380:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615937280 00000100:00100000:3.0:1769074910.942467:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1769074910.942479:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2417:x1855007615937280:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074910.942795:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.942825:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2800f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.942903:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074910.942923:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.942937:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.942953:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074910.942961:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.942967:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943123:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943131:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943137:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943143:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.943148:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943155:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943170:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.943173:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.943179:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943185:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe59fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943225:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943232:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943237:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943241:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.943245:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943251:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943258:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3ee4d1be (ffff91604ecb7b00) 00010000:00010000:3.0:1769074910.943261:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.943264:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943270:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a03 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074910.943324:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59f5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2800f expref: 243 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.943334:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.943337:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074910.943340:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe59f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2800f expref: 243 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.943352:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc -2) 00000100:00100000:3.0:1769074910.943870:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2417:x1855007615937280:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1389us (1610us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074910.943882:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1769074910.970589:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615937664 00000100:00100000:3.0:1769074910.970603:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615937664 00000100:00100000:3.0:1769074910.970675:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8868 00000100:00100000:3.0:1769074910.970686:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:66789:x1855007615937664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074910.970717:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074910.970744:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5a49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28024 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.970833:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074910.970850:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970864:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970880:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074910.970887:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970893:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970962:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970969:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970975:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970981:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970987:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.970992:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.970999:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971013:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.971017:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.971022:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971028:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5a50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971063:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971068:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971073:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971078:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074910.971081:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971086:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971092:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x60af6a1e (ffff91604ecb7b00) 00010000:00010000:3.0:1769074910.971095:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.971097:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971107:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5a57 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x60af6a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074910.971160:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5a49 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28024 expref: 243 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.971172:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074910.971174:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074910.971178:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5a49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28024 expref: 243 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.971187:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7e00, rc 0) 00000100:00100000:3.0:1769074910.971257:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:66789:x1855007615937664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 572us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074910.971265:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8868 00000100:00100000:3.0:1769074910.993313:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615938304 00000100:00100000:3.0:1769074910.993325:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615938304 00010000:00010000:3.0:1769074910.993409:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4200/0x557988ac98fe5a81 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28032 expref: 117 pid: 8405 timeout: 2000 lvb_type: 1 00000100:00100000:3.0:1769074910.993466:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1794 00000100:00100000:3.0:1769074910.993477:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+117:2420:x1855007615938304:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074910.993499:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074910.993567:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4200/0x557988ac98fe5a81 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28032 expref: 117 pid: 8405 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074910.993585:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4200/0x557988ac98fe5a81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28032 expref: 117 pid: 8405 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074910.993619:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.993622:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074910.993632:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d0ecc00/0x557988ac98fe5a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28039 expref: 117 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.993643:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d0ecc00/0x557988ac98fe5a88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28039 expref: 117 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074910.993693:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d0ecc00/0x557988ac98fe5a88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28039 expref: 117 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074910.993710:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626594176:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074910.993814:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074910.999614:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626594176:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074910.999650:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074911.000652:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+115:2420:x1855007615938304:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7171us (7490us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.000665:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1794 00000100:00100000:3.0:1769074911.088296:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615939200 00000100:00100000:3.0:1769074911.088310:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615939200 00000100:00100000:3.0:1769074911.088403:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8873 00000100:00100000:3.0:1769074911.088414:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:66794:x1855007615939200:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.088442:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.088481:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ae3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2805c expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.088843:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.088863:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.088876:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.088893:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.088900:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.088906:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.088986:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089329:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089339:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089347:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089353:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.089359:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089371:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089395:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.089399:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.089406:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089413:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5aea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089433:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089440:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089446:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089450:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.089453:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089459:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089476:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc3af0ef (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.089479:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.089481:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089487:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5af1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc3af0ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.089943:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ae3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2805c expref: 247 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.089957:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.089960:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.089964:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ae3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2805c expref: 247 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.089976:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.124366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.128672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.133451:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615939968 00000100:00100000:3.0:1769074911.133464:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615939968 00010000:00010000:3.0:1769074911.133603:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0eda00/0x557988ac98fe5b30 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28071 expref: 116 pid: 25313 timeout: 2000 lvb_type: 1 00000100:00100000:3.0:1769074911.133651:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1795 00000100:00100000:3.0:1769074911.133661:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+116:2420:x1855007615939968:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074911.133680:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074911.133705:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d0eda00/0x557988ac98fe5b30 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28071 expref: 116 pid: 25313 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074911.133723:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d0eda00/0x557988ac98fe5b30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28071 expref: 116 pid: 25313 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074911.133755:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.133759:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.133767:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4e00/0x557988ac98fe5b37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28078 expref: 116 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.133778:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4e00/0x557988ac98fe5b37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28078 expref: 116 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.133826:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1b4e00/0x557988ac98fe5b37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28078 expref: 116 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074911.133845:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626594432:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074911.133960:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074911.138257:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626594432:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074911.138301:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074911.138379:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+114:2420:x1855007615939968:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4717us (5058us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.138404:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1795 00000100:00100000:3.0:1769074911.144898:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615940224 00000100:00100000:3.0:1769074911.144912:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615940224 00000100:00100000:3.0:1769074911.144986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1780 00000100:00100000:3.0:1769074911.144998:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+249:66794:x1855007615940224:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074911.145423:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:66794:x1855007615940224:12345-192.168.204.32@tcp:35:cp.0 Request processed in 425us (809us total) trans 4294968845 rc 0/0 00000100:00100000:3.0:1769074911.145432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1780 00000100:00100000:3.0:1769074911.216033:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615940736 00000100:00100000:3.0:1769074911.216047:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615940736 00000100:00100000:3.0:1769074911.216129:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8878 00000100:00100000:3.0:1769074911.216143:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:66798:x1855007615940736:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074911.216175:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.216204:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5b68 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28094 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.216293:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.216313:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216327:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216343:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.216350:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216356:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216434:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216442:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216449:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216455:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216466:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.216471:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216479:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216493:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.216497:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.216502:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216508:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5b6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216524:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216976:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.216985:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.217047:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.217051:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.217058:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.217067:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1349dd9d (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.217070:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.217074:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.217080:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5b76 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.217124:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5b68 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28094 expref: 251 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.217135:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.217138:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.217142:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5b68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28094 expref: 251 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.217153:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.217294:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:66798:x1855007615940736:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1153us (1407us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074911.217304:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8878 00000100:00100000:3.0:1769074911.248171:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615940992 00000100:00100000:3.0:1769074911.248184:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615940992 00000100:00100000:3.0:1769074911.248259:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8880 00000100:00100000:3.0:1769074911.248269:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:66799:x1855007615940992:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.248296:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.248324:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ba7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e280a2 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.248422:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.248439:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248455:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248470:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.248476:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248482:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248605:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248613:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248618:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248625:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248631:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.248635:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248643:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248657:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.248661:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.248667:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248673:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248691:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248698:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248704:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248708:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.248711:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248716:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248722:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1349dd9d (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.248725:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.248727:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248732:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bb5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1349dd9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.248781:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ba7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280a2 expref: 251 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.248791:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.248793:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.248797:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5ba7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280a2 expref: 251 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.248806:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.248880:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:66799:x1855007615940992:12345-192.168.204.32@tcp:101:cp.0 Request processed in 612us (835us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074911.248889:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8880 00000100:00100000:3.0:1769074911.271175:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615941632 00000100:00100000:3.0:1769074911.271188:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615941632 00010000:00010000:3.0:1769074911.271255:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1d4e00/0x557988ac98fe5bdf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b0 expref: 118 pid: 8405 timeout: 2000 lvb_type: 1 00000100:00100000:3.0:1769074911.271302:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1796 00000100:00100000:3.0:1769074911.271312:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+118:2419:x1855007615941632:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074911.271332:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074911.271357:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1d4e00/0x557988ac98fe5bdf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b0 expref: 118 pid: 8405 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074911.271375:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1d4e00/0x557988ac98fe5bdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b0 expref: 118 pid: 8405 timeout: 2000 lvb_type: 1 00010000:00010000:3.0:1769074911.271417:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.271420:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.271429:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d0eda00/0x557988ac98fe5be6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b7 expref: 118 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.271441:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d0eda00/0x557988ac98fe5be6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b7 expref: 118 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.271488:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d0eda00/0x557988ac98fe5be6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280b7 expref: 118 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074911.271852:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626594944:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074911.271965:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a480 going to sleep for 11 seconds 00000100:00100000:3.0:1769074911.278838:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f6a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626594944:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074911.278878:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074911.278952:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+116:2419:x1855007615941632:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7640us (7889us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.278966:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1796 00000100:00100000:3.0:1769074911.315261:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615942016 00000100:00100000:3.0:1769074911.315275:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615942016 00000100:00100000:3.0:1769074911.315356:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8882 00000100:00100000:3.0:1769074911.315367:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66802:x1855007615942016:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074911.315404:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.315435:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5bed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e280be expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.315589:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.315607:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315621:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315873:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.315884:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315891:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315961:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315969:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315976:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315983:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.315990:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.316080:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316090:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316105:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.316109:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.316115:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316122:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5bf4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316140:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316147:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316152:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316158:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.316161:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316166:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316174:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x56ac27dc (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.316176:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.316179:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316184:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5bfb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x56ac27dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.316228:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5bed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280be expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.316240:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.316243:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.316247:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5bed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e280be expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.316263:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.316342:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66802:x1855007615942016:12345-192.168.204.32@tcp:101:bash.0 Request processed in 975us (1553us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074911.316352:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8882 00000100:00100000:3.0:1769074911.328472:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615942144 00000100:00100000:3.0:1769074911.328486:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615942144 00000100:00100000:3.0:1769074911.377590:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.384029:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.393622:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626595200:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074911.393658:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074911.393734:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916180fe5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+115:2419:x1855007615943296:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5580us (9721us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.393747:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1797 00000100:00100000:3.0:1769074911.580463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.585282:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615945728 00000100:00100000:3.0:1769074911.585298:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615945728 00000100:00100000:3.0:1769074911.585373:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8896 00000100:00100000:3.0:1769074911.585393:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:66814:x1855007615945728:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074911.585417:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.585441:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5d8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28182 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.585797:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.585815:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585828:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585845:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.585852:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585859:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585936:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585944:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585950:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585958:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585964:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.585969:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.585978:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586001:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.586004:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.586011:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586017:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5d91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586032:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586038:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586044:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586049:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.586052:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586058:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586065:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3749e029 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.586067:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.586070:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586077:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5d98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.586113:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5d8a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28182 expref: 263 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.586124:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.586127:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.586131:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5d8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28182 expref: 263 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.586140:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.586229:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:66814:x1855007615945728:12345-192.168.204.32@tcp:101:rm.0 Request processed in 837us (3444us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074911.586238:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8896 00000100:00100000:3.0:1769074911.609046:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615945984 00000100:00100000:3.0:1769074911.609061:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615945984 00000100:00100000:3.0:1769074911.609126:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1769074911.609136:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2418:x1855007615945984:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074911.609206:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.609232:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5db4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28190 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.609303:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074911.609320:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609333:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609348:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074911.609356:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609362:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609431:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609439:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609447:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609454:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.609788:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609799:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609813:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.609816:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.609821:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609827:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dbb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609842:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609848:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609854:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609859:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.609863:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609868:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609875:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b0dbb78 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.609878:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.609881:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609885:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dc2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b0dbb78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.609923:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5db4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28190 expref: 263 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.609933:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.609935:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074911.609938:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5db4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28190 expref: 263 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.609947:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc -2) 00000100:00100000:3.0:1769074911.610036:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2418:x1855007615945984:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 900us (3030us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074911.610044:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1769074911.617000:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615946112 00000100:00100000:3.0:1769074911.617015:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615946112 00000100:00100000:3.0:1769074911.617094:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8898 00000100:00100000:3.0:1769074911.617106:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:66817:x1855007615946112:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.617138:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.617164:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5dc9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e281c8 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.617252:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.617272:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617286:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617301:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.617308:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617314:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617395:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617403:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617409:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617416:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617422:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.617427:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617435:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617450:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.617453:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.617468:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617475:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5dd0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.617489:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618289:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618297:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618303:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.618307:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618313:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618325:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3749e029 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.618329:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.618332:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618342:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5dd7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.618413:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5dc9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e281c8 expref: 263 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.618425:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.618427:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.618432:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5dc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e281c8 expref: 263 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.618444:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.618600:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:66817:x1855007615946112:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1494us (2123us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074911.618609:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8898 00000100:00100000:3.0:1769074911.623963:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615946368 00000100:00100000:3.0:1769074911.623977:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615946368 00000100:00100000:3.0:1769074911.624053:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8899 00000100:00100000:3.0:1769074911.624065:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:66817:x1855007615946368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.624095:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.624123:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5dde lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e281cf expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.624334:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5de5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.624354:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5de5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.624373:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5de5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.624401:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5dec lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3749e029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074911.624409:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5dec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074911.624415:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe5dec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3749e029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000100:00100000:3.0:1769074911.633454:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615946496 00000100:00100000:3.0:1769074911.633468:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615946496 00000100:00100000:3.0:1769074911.633578:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2539 00000100:00100000:3.0:1769074911.633590:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+115:2420:x1855007615946496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.633617:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.633644:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e01 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e281d6 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074911.633674:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074911.633699:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.633702:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.633714:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e281d6 expref: 116 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.633735:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e281d6 expref: 116 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.633758:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6000, rc 0) 00000100:00100000:3.0:1769074911.633828:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+116:2420:x1855007615946496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 239us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.633836:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2539 00000100:00100000:3.0:1769074911.705683:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615947520 00000100:00100000:3.0:1769074911.705690:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615947520 00000100:00100000:3.0:1769074911.705730:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:3.0:1769074911.705737:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2419:x1855007615947520:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074911.705764:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.705777:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e4e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2822a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.705816:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074911.705827:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705835:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705849:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074911.705856:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705862:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705898:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705904:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705910:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705915:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.705918:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705923:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705931:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.705934:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.705936:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705941:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5e55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705970:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705976:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705983:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705987:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.705991:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.705997:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.706003:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37f49953 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.706005:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.706007:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.706012:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36c00/0x557988ac98fe5e5c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074911.706032:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e4e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2822a expref: 267 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.706039:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.706041:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074911.706044:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a6000/0x557988ac98fe5e4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2822a expref: 267 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.706067:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6000, rc -2) 00000100:00100000:3.0:1769074911.706885:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2419:x1855007615947520:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1140us (2404us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074911.706897:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:3.0:1769074911.750784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.755464:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615948416 00000100:00100000:3.0:1769074911.755478:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615948416 00000100:00100000:3.0:1769074911.755609:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2542 00000100:00100000:3.0:1769074911.755622:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+118:66826:x1855007615948416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.755649:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.755678:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a36c00/0x557988ac98fe5ecc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28254 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.755717:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b4b200/0x557988ac98fe5ec5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2824d expref: 119 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.755726:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.755728:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.755732:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a36c00/0x557988ac98fe5ecc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28254 expref: 119 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.755779:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052b4b200/0x557988ac98fe5ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2824d expref: 119 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.755796:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052b4b200/0x557988ac98fe5ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2824d expref: 119 pid: 25313 timeout: 2001 lvb_type: 1 00000100:00100000:3.0:1769074911.755812:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626595840:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074911.755954:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044a9a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1769074911.760505:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052b4b200/0x557988ac98fe5ec5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2824d expref: 120 pid: 25313 timeout: 2001 lvb_type: 1 00000100:00100000:3.0:1769074911.760526:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626595840:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074911.760616:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a36c00/0x557988ac98fe5ecc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28254 expref: 119 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.760635:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36c00, rc 0) 00000100:00100000:3.0:1769074911.760683:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+119:66826:x1855007615948416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5064us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.760692:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2542 00000100:00100000:3.0:1769074911.766252:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615948800 00000100:00100000:3.0:1769074911.766265:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615948800 00000100:00100000:3.0:1769074911.766333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1785 00000100:00100000:3.0:1769074911.766342:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:66826:x1855007615948800:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074911.767346:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+270:66826:x1855007615948800:12345-192.168.204.32@tcp:35:cp.0 Request processed in 997us (1358us total) trans 4294968855 rc 0/0 00000100:00100000:3.0:1769074911.767357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1785 00000100:00100000:3.0:1769074911.816942:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615949056 00000100:00100000:3.0:1769074911.816958:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615949056 00000100:00100000:3.0:1769074911.850333:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615949568 00000100:00100000:3.0:1769074911.850347:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615949568 00000100:00100000:3.0:1769074911.850476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8910 00000100:00100000:3.0:1769074911.850489:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+270:66831:x1855007615949568:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.850574:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.850602:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5f3c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2827e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.850696:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074911.850716:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850735:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850752:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074911.850759:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850766:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850837:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850845:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850851:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850859:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850866:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.850871:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850879:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850893:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.850897:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.850902:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe5f43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850924:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850929:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850935:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850940:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074911.850942:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850948:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850955:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee2498af (ffff91604ecb7b00) 00010000:00010000:3.0:1769074911.850957:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.850960:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.850965:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe5f4a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee2498af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074911.851258:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5f3c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2827e expref: 271 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.851271:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074911.851275:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074911.851279:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe5f3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2827e expref: 271 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.851289:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074911.855264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074911.864731:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615949952 00000100:00100000:3.0:1769074911.864747:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615949952 00000100:00100000:3.0:1769074911.864853:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2543 00000100:00100000:3.0:1769074911.864865:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+116:2419:x1855007615949952:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.864891:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.864919:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5f74 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2828c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074911.864948:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074911.864973:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.864975:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.864998:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5f74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2828c expref: 117 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.865019:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5f74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2828c expref: 117 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.865034:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a6000, rc 0) 00000100:00100000:3.0:1769074911.865118:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+117:2419:x1855007615949952:12345-192.168.204.32@tcp:101:cp.0 Request processed in 255us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074911.865126:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2543 00000100:00100000:3.0:1769074911.869219:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615950080 00000100:00100000:3.0:1769074911.869232:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615950080 00000100:00100000:3.0:1769074911.869335:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2544 00000100:00100000:3.0:1769074911.869347:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+117:66831:x1855007615950080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074911.869381:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074911.869409:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5f7b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28293 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074911.869453:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9160449a6000/0x557988ac98fe5f74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2828c expref: 118 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074911.869751:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.869754:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074911.869759:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9160449a7e00/0x557988ac98fe5f7b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28293 expref: 118 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074911.885062:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615950464 00000100:00100000:3.0:1769074911.885075:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615950464 00000100:00100000:3.0:1769074911.885152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1786 00000100:00100000:3.0:1769074911.885164:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66831:x1855007615950464:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074911.886005:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+274:66831:x1855007615950464:12345-192.168.204.32@tcp:35:cp.0 Request processed in 836us (1366us total) trans 4294968857 rc 0/0 00000100:00100000:3.0:1769074911.886017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1786 00000100:00100000:3.0:1769074912.027665:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615952128 00000100:00100000:3.0:1769074912.027680:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615952128 00000100:00100000:3.0:1769074912.027753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1787 00000100:00100000:3.0:1769074912.027764:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:66837:x1855007615952128:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074912.028175:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+278:66837:x1855007615952128:12345-192.168.204.32@tcp:35:cp.0 Request processed in 412us (720us total) trans 4294968859 rc 0/0 00000100:00100000:3.0:1769074912.028186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1787 00000100:00100000:3.0:1769074912.078313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.083705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.112093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.116043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.130680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.134460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.184737:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.226082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.231663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.237056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.237107:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615954816 00000100:00100000:3.0:1769074912.237120:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615954816 00000100:00100000:3.0:1769074912.237201:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8929 00000100:00100000:3.0:1769074912.237212:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+282:66847:x1855007615954816:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074912.237239:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074912.237265:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe615e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28342 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.237431:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.238052:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.238072:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.238098:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe616c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.238109:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe616c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.238116:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe616c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074912.239252:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x8c:0x0], index 0: 0 00010000:00010000:3.0:1769074912.239897:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7800/0x557988ac98fe6173 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x122:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.239916:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7800/0x557988ac98fe6173 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.239929:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7800/0x557988ac98fe6173 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.239975:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240063:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240070:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240077:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.240081:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240090:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240105:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.240109:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.240115:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240121:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe6165 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074912.240139:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d20f87a4 reply state 0000000086d1ff8d transno 4294968862 ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe616c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240152:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe616c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d4da12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.240158:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d4da12 (ffff91604ecb7b00) 00010000:00010000:3.0:1769074912.240160:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074912.240164:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074912.240211:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe615e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28342 expref: 285 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.240229:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7800/0x557988ac98fe6173 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x122:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28342 expref: 284 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.240236:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x122:0x0].0x0 (ffff91604ecb7900) 00010000:00010000:3.0:1769074912.240239:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074912.240241:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7800, rc 0) 00000100:00100000:3.0:1769074912.240387:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:66847:x1855007615954816:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3174us (3343us total) trans 4294968862 rc 0/0 00000100:00100000:3.0:1769074912.240398:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8929 00000100:00100000:3.0:1769074912.253627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.264613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.312174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.327596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.333582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.339105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.363942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.365112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.379662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.388266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.398032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.403394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.415065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.441786:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615957376 00000100:00100000:3.0:1769074912.441802:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615957376 00000100:00100000:3.0:1769074912.441893:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:3.0:1769074912.441905:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+290:2417:x1855007615957376:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074912.441979:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074912.442006:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6253 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e283ff expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.442085:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074912.442104:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442119:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442134:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074912.442141:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442148:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442219:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442228:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442235:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442240:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa7000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.442245:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442253:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442268:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.442272:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.442277:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442284:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe625a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442300:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442306:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442311:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442317:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.442320:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442326:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442333:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x939243ab (ffff91604ecb7500) 00010000:00010000:3.0:1769074912.442335:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.442338:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442344:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6261 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074912.442391:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6253 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e283ff expref: 291 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.442401:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.442404:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074912.442408:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6253 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e283ff expref: 291 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.442417:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc -2) 00000100:00100000:3.0:1769074912.442520:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+290:2417:x1855007615957376:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 616us (1101us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074912.442996:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:3.0:1769074912.472997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.498448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.534765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.541611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.595070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.611899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.619325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.668396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.699972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.716493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.749196:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615959936 00000100:00100000:3.0:1769074912.749213:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615959936 00000100:00100000:3.0:1769074912.749295:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8945 00000100:00100000:3.0:1769074912.749308:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+294:66875:x1855007615959936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074912.749339:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074912.749380:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6395 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28533 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.749485:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074912.749505:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749520:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749600:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074912.749608:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749615:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749704:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749712:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749719:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749725:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.749731:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749739:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749753:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.749756:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.749763:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749769:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe639c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749787:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749793:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749799:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749803:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.749806:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749811:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749818:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf5f484a5 (ffff91604ecb7300) 00010000:00010000:3.0:1769074912.749820:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.749823:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749828:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe63a3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf5f484a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074912.749884:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6395 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28533 expref: 295 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.749896:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.749899:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.749904:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6395 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28533 expref: 295 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.749915:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074912.750235:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+294:66875:x1855007615959936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 928us (1466us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074912.750244:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8945 00000100:00100000:3.0:1769074912.771804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.794710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.889364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.935128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.935185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074912.975458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1769074912.981364:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.981374:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981382:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981456:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981462:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981468:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981472:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.981474:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981480:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981488:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.981490:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.981493:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981499:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe646e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981510:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981574:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981582:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981587:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.981590:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981596:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981604:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b6b9d4b (ffff91604ecb7300) 00010000:00010000:3.0:1769074912.981607:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.981609:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981614:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe647c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.981646:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247400/0x557988ac98fe6460 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285aa expref: 300 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.981654:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.981656:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.981660:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247400/0x557988ac98fe6460 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285aa expref: 300 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.981669:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e247400, rc 0) 00000100:00100000:3.0:1769074912.981757:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:66882:x1855007615961728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5157us (6313us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074912.981769:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8951 00000100:00100000:3.0:1769074912.988859:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615961984 00000100:00100000:3.0:1769074912.988898:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615961984 00000100:00100000:3.0:1769074912.989172:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8952 00000100:00100000:3.0:1769074912.989186:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:66882:x1855007615961984:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074912.989215:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074912.989245:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6483 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e285e9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.989340:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.989369:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989382:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989400:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.989407:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989414:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989487:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989505:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989693:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989703:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.989708:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989716:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989734:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.989737:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.989743:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989750:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe648a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989765:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989771:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989776:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989781:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa7000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074912.989784:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989790:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989802:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b6b9d4b (ffff91604ecb7000) 00010000:00010000:3.0:1769074912.989804:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.989808:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989813:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6491 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.989855:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6483 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285e9 expref: 299 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.990255:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074912.990260:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074912.990266:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6483 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285e9 expref: 299 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.990279:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074912.990468:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:66882:x1855007615961984:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1284us (3994us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074912.990478:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8952 00000100:00100000:3.0:1769074912.996349:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615962240 00000100:00100000:3.0:1769074912.996372:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615962240 00000100:00100000:3.0:1769074912.996452:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8953 00000100:00100000:3.0:1769074912.996466:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:66882:x1855007615962240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074912.996727:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074912.996757:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6498 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e285f0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074912.997132:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.997153:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.997168:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.997186:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe64a6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074912.997194:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe64a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074912.997200:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe64a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074913.002766:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x8e:0x0], index 0: 0 00010000:00010000:3.0:1769074913.004318:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe64ad lrc: 3/1,0 mode: --/PR res: [0x240000403:0x126:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074913.004346:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe64ad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004371:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe64ad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004422:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004430:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004443:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004451:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.004457:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004466:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.004482:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.004486:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.006205:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.006230:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe649f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074913.006255:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007e15983d reply state 00000000c63cfbc5 transno 4294968870 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe64a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.006276:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe64a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b6b9d4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074913.006286:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b6b9d4b (ffff91604ecb7300) 00010000:00010000:3.0:1769074913.006290:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074913.006295:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074913.006377:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6498 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285f0 expref: 301 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.006397:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36e00/0x557988ac98fe64ad lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x126:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e285f0 expref: 300 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.006411:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x126:0x0].0x0 (ffff91604ecb7f00) 00010000:00010000:3.0:1769074913.006414:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074913.006417:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36e00, rc 0) 00000100:00100000:3.0:1769074913.006722:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:66882:x1855007615962240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10257us (10507us total) trans 4294968870 rc 0/0 00000100:00100000:3.0:1769074913.006733:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8953 00000100:00100000:3.0:1769074913.052981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074913.077459:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074913.109384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.119918:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615963136 00000100:00100000:3.0:1769074913.119944:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615963136 00000100:00080000:3.0:1769074913.127079:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074913.147487:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615963264 00000100:00100000:3.0:1769074913.147514:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615963264 00000100:00100000:3.0:1769074913.147611:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8955 00000100:00100000:3.0:1769074913.147622:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+302:66890:x1855007615963264:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074913.147649:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074913.147675:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6508 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28644 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.147768:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.147786:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147800:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147823:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.147829:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147835:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147903:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147911:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147918:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147925:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.147931:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147940:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147953:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.147957:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.147963:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147968:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe650f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147981:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147987:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147993:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.147997:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.148000:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.148005:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.148013:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x939243ab (ffff91604ecb7000) 00010000:00010000:3.0:1769074913.148015:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.148018:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.148024:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6516 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.148064:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6508 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28644 expref: 303 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.148075:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.148077:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.148080:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6508 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28644 expref: 303 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.148088:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a37e00, rc 0) 00000100:00100000:3.0:1769074913.148177:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+302:66890:x1855007615963264:12345-192.168.204.32@tcp:101:rm.0 Request processed in 556us (1040us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074913.148187:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8955 00000100:00100000:3.0:1769074913.172140:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615963648 00000100:00100000:3.0:1769074913.172166:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615963648 00000100:00100000:3.0:1769074913.172268:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8957 00000100:00100000:3.0:1769074913.172281:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+302:66891:x1855007615963648:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074913.172312:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074913.172342:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6532 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28659 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.172453:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6539 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.172475:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6539 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.172490:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6539 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.172507:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6540 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.172525:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.172585:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x939243ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000100:00080000:3.0:1769074913.201359:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074913.347916:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615965184 00000100:00100000:3.0:1769074913.347928:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615965184 00000100:00100000:3.0:1769074913.347991:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:3.0:1769074913.348002:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2417:x1855007615965184:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074913.348042:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074913.348064:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe65cc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28691 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.348127:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074913.348144:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348157:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348174:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074913.348181:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348189:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348246:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348254:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348261:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348267:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.348272:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348280:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348293:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.348296:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.348301:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348307:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe65d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348320:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348327:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348333:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348338:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa7000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.348340:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348346:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348363:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604f17dd00) 00010000:00010000:3.0:1769074913.348365:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.348368:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348373:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe65da lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074913.348403:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe65cc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28691 expref: 308 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.348412:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.348415:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074913.348419:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe65cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28691 expref: 308 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.348430:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc -2) 00000100:00100000:3.0:1769074913.348930:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2417:x1855007615965184:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 925us (1473us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074913.348940:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:3.0:1769074913.390665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.399137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.441146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.498075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.504236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.530413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.559827:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.568147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.597149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.603687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.614639:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8972 00000100:00100000:3.0:1769074913.614659:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66911:x1855007615968512:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074913.614688:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074913.614727:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe672a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e287a2 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.614826:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.614846:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614859:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614875:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074913.614883:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614889:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614979:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614987:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614993:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.614999:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.615005:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615012:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615031:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.615035:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.615041:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615047:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6731 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615062:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615068:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615073:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615078:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074913.615081:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615087:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615094:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x126a0d33 (ffff91604f17dd00) 00010000:00010000:3.0:1769074913.615096:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.615099:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615104:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6738 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x126a0d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074913.615142:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe672a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e287a2 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.615154:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074913.615157:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074913.615161:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe672a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e287a2 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074913.615171:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074913.615275:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66911:x1855007615968512:12345-192.168.204.32@tcp:101:bash.0 Request processed in 620us (11606us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074913.615284:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8972 00000100:00100000:3.0:1769074913.628179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.628240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.638696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.698969:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.768368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.768427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.777029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.798355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.813771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.824092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.854148:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615971712 00000100:00100000:3.0:1769074913.854158:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615971712 00000100:00100000:3.0:1769074913.854266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1798 00000100:00100000:3.0:1769074913.854277:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+322:66918:x1855007615971712:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074913.854622:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+323:66918:x1855007615971712:12345-192.168.204.32@tcp:35:cp.0 Request processed in 346us (662us total) trans 4294968882 rc 0/0 00000100:00100000:3.0:1769074913.854633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1798 00000100:00100000:3.0:1769074913.925112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.953157:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.972495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.981974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.987191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.994250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.994299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074913.994374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074913.996258:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074914.097320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.097408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.103558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.131748:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615974528 00000100:00100000:3.0:1769074914.131762:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615974528 00000100:00100000:3.0:1769074914.131838:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8994 00000100:00100000:3.0:1769074914.131850:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+327:66929:x1855007615974528:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.131877:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.131905:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28882 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.132013:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.132033:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132047:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132066:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.132073:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132079:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132149:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132157:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132164:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132170:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.132175:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132183:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132196:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.132200:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.132206:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132212:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe69a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132226:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132233:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132238:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132242:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.132245:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132250:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132257:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7fa4735 (ffff91604f17dd00) 00010000:00010000:3.0:1769074914.132260:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.132262:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132268:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe69ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7fa4735 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.132302:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69a0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28882 expref: 328 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.132311:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.132314:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.132318:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28882 expref: 328 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.132327:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074914.132413:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+327:66929:x1855007615974528:12345-192.168.204.32@tcp:101:cp.0 Request processed in 565us (819us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.132421:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8994 00000100:00080000:3.0:1769074914.147203:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074914.147657:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626599680 00000100:00100000:3.0:1769074914.147670:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626599680 00000100:00100000:3.0:1769074914.147736:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1769074914.147747:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1855007626599680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769074914.147780:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484938432 pending 896 free 3764449280 avail 3532926976 00000100:00100000:3.0:1769074914.153086:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1855007626599680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5332us (8835us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.153100:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1769074914.179196:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615975424 00000100:00100000:3.0:1769074914.179209:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615975424 00000100:00100000:3.0:1769074914.179281:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1800 00000100:00100000:3.0:1769074914.179294:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181002c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+330:66929:x1855007615975424:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074914.180099:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181002c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66929:x1855007615975424:12345-192.168.204.32@tcp:35:cp.0 Request processed in 802us (1289us total) trans 4294968886 rc 0/0 00000100:00100000:3.0:1769074914.180109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1800 00000100:00100000:3.0:1769074914.232779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.259457:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615975680 00000100:00100000:3.0:1769074914.259473:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615975680 00000100:00100000:3.0:1769074914.259612:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8997 00000100:00100000:3.0:1769074914.259625:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66933:x1855007615975680:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074914.259658:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.259687:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288a5 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.259781:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.259800:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259812:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259829:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.259836:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259843:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259920:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259928:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259934:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259940:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.259945:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259953:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259972:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.259975:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.259982:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.259988:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260004:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260010:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260016:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260021:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.260024:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260030:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260037:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2caa80d2 (ffff91604f17dd00) 00010000:00010000:3.0:1769074914.260039:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.260042:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260048:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.260084:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69fb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288a5 expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.260097:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.260100:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.260104:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe69fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288a5 expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.260115:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074914.260213:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66933:x1855007615975680:12345-192.168.204.32@tcp:101:rm.0 Request processed in 591us (1276us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.260222:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8997 00000100:00100000:3.0:1769074914.291907:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615976064 00000100:00100000:3.0:1769074914.291923:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615976064 00000100:00100000:3.0:1769074914.292111:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8999 00000100:00100000:3.0:1769074914.292123:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66934:x1855007615976064:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.292151:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.292178:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6a3a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288ba expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.292272:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.292292:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292305:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292322:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.292346:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292353:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292421:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292429:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292436:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292443:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.292448:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292457:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292473:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.292476:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.292482:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292488:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6a41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292517:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292523:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292661:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292669:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.292672:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292678:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292685:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2caa80d2 (ffff91604f17dd00) 00010000:00010000:3.0:1769074914.292688:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.292690:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292696:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6a48 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.292734:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6a3a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288ba expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.292745:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.292748:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.292752:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6a3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288ba expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.292762:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074914.292845:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66934:x1855007615976064:12345-192.168.204.32@tcp:101:cp.0 Request processed in 723us (1116us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.292853:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8999 00000100:00100000:3.0:1769074914.296065:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615976192 00000100:00100000:3.0:1769074914.296080:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615976192 00000100:00100000:3.0:1769074914.296155:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9000 00000100:00100000:3.0:1769074914.296168:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66934:x1855007615976192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.296197:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.296221:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6a4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288c1 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.296341:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.296360:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296373:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296391:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.296398:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296404:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296473:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296480:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296487:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296494:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.296498:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296506:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296520:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.296524:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.296567:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296574:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ee00/0x557988ac98fe6a56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296593:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296599:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296605:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296611:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a37e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.296614:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296620:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296627:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2caa80d2 (ffff91604f17db00) 00010000:00010000:3.0:1769074914.296629:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.296632:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296637:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a37e00/0x557988ac98fe6a5d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2caa80d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.296673:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6a4f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288c1 expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.296684:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.296687:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.296690:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6a4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288c1 expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.296702:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074914.296782:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:66934:x1855007615976192:12345-192.168.204.32@tcp:101:cp.0 Request processed in 618us (827us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.296790:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9000 00000100:00080000:3.0:1769074914.305189:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074914.312756:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615976576 00000100:00100000:3.0:1769074914.312771:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615976576 00000100:00100000:3.0:1769074914.312845:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2575 00000100:00100000:3.0:1769074914.312857:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+125:2420:x1855007615976576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.312881:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.312910:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288cf expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074914.312942:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074914.312970:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.312974:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.312984:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288cf expref: 126 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.313002:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288cf expref: 126 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.313019:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a37e00, rc 0) 00000100:00100000:3.0:1769074914.313105:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+126:2420:x1855007615976576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 249us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.313115:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2575 00000100:00100000:3.0:1769074914.320697:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615976704 00000100:00100000:3.0:1769074914.320712:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615976704 00000100:00100000:3.0:1769074914.320791:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2576 00000100:00100000:3.0:1769074914.320804:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+126:66934:x1855007615976704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.320830:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.320855:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91615db8ee00/0x557988ac98fe6a8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288d6 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.320898:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288cf expref: 127 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.320908:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.320911:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.320916:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91615db8ee00/0x557988ac98fe6a8e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288d6 expref: 127 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.320962:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288cf expref: 127 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.320981:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916174a37e00/0x557988ac98fe6a87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288cf expref: 127 pid: 25313 timeout: 2003 lvb_type: 1 00000100:00100000:3.0:1769074914.320998:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fa3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626600320:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074914.321127:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074914.323372:0:8615:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8615:1855007626600192:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1769074914.323392:0:8615:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x92:0x0]-[0x280000400:0xc1:0x0] 00000100:00100000:3.0:1769074914.332178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.350179:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615977088 00000100:00100000:3.0:1769074914.350194:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615977088 00000100:00100000:3.0:1769074914.351149:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1801 00000100:00100000:3.0:1769074914.351167:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+334:66934:x1855007615977088:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074914.351694:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+335:66934:x1855007615977088:12345-192.168.204.32@tcp:35:cp.0 Request processed in 529us (2722us total) trans 4294968888 rc 0/0 00000100:00100000:3.0:1769074914.351703:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1801 00000100:00100000:3.0:1769074914.419351:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615977344 00000100:00100000:3.0:1769074914.419366:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615977344 00000100:00100000:3.0:1769074914.419447:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9002 00000100:00100000:3.0:1769074914.419459:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66937:x1855007615977344:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074914.419488:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.419515:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6aaa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e288e4 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.419657:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.419677:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419690:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419707:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.419714:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419720:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419786:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419794:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419800:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419807:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.419811:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419819:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419832:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.419835:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.419842:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419848:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ab1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419862:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419868:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419874:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419879:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.419882:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419888:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419894:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x13c8fbc3 (ffff91604f17dc00) 00010000:00010000:3.0:1769074914.419897:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.419899:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419905:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ab8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x13c8fbc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.419942:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6aaa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288e4 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.419954:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.419957:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.419961:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6aaa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e288e4 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.419971:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074914.420770:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:66937:x1855007615977344:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1304us (1567us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.420783:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9002 00000100:00100000:3.0:1769074914.456674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.464065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.484301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.489570:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615977984 00000100:00100000:3.0:1769074914.489584:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615977984 00000100:00100000:3.0:1769074914.489664:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:3.0:1769074914.489677:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:2419:x1855007615977984:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074914.489756:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.489786:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28938 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.489874:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.489893:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.489906:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.489924:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.489937:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.489957:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490039:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490047:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490054:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490062:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.490073:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490081:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490096:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.490100:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.490106:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490112:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490126:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490132:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490138:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490143:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.490147:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490153:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490161:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfe8f7efb (ffff91604f17dc00) 00010000:00010000:3.0:1769074914.490164:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.490167:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490173:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b21 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.490208:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b13 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28938 expref: 337 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.490218:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.490220:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074914.490223:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28938 expref: 337 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.490232:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc -2) 00000100:00100000:3.0:1769074914.490343:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:2419:x1855007615977984:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 657us (934us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074914.490351:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:3.0:1769074914.499601:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.524683:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615978496 00000100:00100000:3.0:1769074914.524697:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615978496 00000100:00100000:3.0:1769074914.524764:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2577 00000100:00100000:3.0:1769074914.524773:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+124:2420:x1855007615978496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.524796:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.524819:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2897e expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074914.524846:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074914.524870:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.524872:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.524884:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2897e expref: 125 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.524906:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2897e expref: 125 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.524922:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074914.525091:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+125:2420:x1855007615978496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 318us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.525098:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2577 00000100:00100000:3.0:1769074914.528287:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615978624 00000100:00100000:3.0:1769074914.528303:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615978624 00000100:00100000:3.0:1769074914.528457:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2578 00000100:00100000:3.0:1769074914.528470:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+125:66941:x1855007615978624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.528503:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.528604:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b67 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28985 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.528676:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2897e expref: 126 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.528686:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.528688:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.528694:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b67 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28985 expref: 126 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.528745:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2897e expref: 126 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.528763:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2897e expref: 126 pid: 8625 timeout: 2003 lvb_type: 1 00000100:00100000:3.0:1769074914.528782:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626600576:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074914.528930:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614b9afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074914.534613:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626600576:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074914.534670:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604daa7000/0x557988ac98fe6b67 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28985 expref: 126 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.534697:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa7000, rc 0) 00000100:00100000:3.0:1769074914.534787:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+126:66941:x1855007615978624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6319us (6695us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.534799:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2578 00000100:00100000:3.0:1769074914.548623:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a69c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626600704:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074914.548661:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074914.548721:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+125:2420:x1855007615978752:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10640us (11044us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.548733:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1817 00000100:00100000:3.0:1769074914.571479:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615979136 00000100:00100000:3.0:1769074914.571502:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615979136 00000100:00100000:3.0:1769074914.571822:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:3.0:1769074914.571835:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:2418:x1855007615979136:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074914.571911:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.571939:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2898c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.572019:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.572037:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572052:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572072:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.572080:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572086:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572157:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572166:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572174:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572180:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.572185:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572193:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572209:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.572213:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.572219:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572225:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6b75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572238:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572243:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572249:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572253:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.572256:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572266:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572272:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfe8f7efb (ffff91604f17d100) 00010000:00010000:3.0:1769074914.572274:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.572276:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572281:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6b7c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.572311:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b6e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2898c expref: 340 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.572321:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.572323:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074914.572498:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6b6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2898c expref: 340 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.572510:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc -2) 00000100:00100000:3.0:1769074914.572633:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:2418:x1855007615979136:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 800us (1329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074914.572642:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:3.0:1769074914.668160:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615979776 00000100:00100000:3.0:1769074914.668175:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615979776 00000100:00100000:3.0:1769074914.668256:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9011 00000100:00100000:3.0:1769074914.668269:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:66951:x1855007615979776:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.668299:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.668336:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e289e0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.668434:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074914.668454:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668471:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668500:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074914.668508:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668515:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668635:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668644:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668653:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668660:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.668666:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668675:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668691:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.668695:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.668701:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668707:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bde lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668723:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668729:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668734:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668738:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.668741:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668746:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668752:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2276f7 (ffff91604f17d100) 00010000:00010000:3.0:1769074914.668754:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.668756:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668761:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6be5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.668800:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bd7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289e0 expref: 340 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.668812:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.668814:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.668818:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289e0 expref: 340 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.668828:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074914.668915:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:66951:x1855007615979776:12345-192.168.204.32@tcp:101:cp.0 Request processed in 648us (889us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.668924:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9011 00000100:00100000:3.0:1769074914.679903:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9012 00000100:00100000:3.0:1769074914.679933:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:66951:x1855007615979904:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.679958:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.679981:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e289e7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.680054:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074914.680068:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680078:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680106:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074914.680114:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680121:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680175:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680182:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680188:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680193:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.680198:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680204:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680215:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.680218:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.680223:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680228:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6bf3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680241:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680246:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680252:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680257:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.680259:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680265:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680272:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2276f7 (ffff91604f17d100) 00010000:00010000:3.0:1769074914.680274:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.680277:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680281:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6bfa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2276f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074914.680309:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289e7 expref: 340 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.680317:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.680319:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.680322:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6bec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289e7 expref: 340 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.680341:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074914.680407:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:66951:x1855007615979904:12345-192.168.204.32@tcp:101:cp.0 Request processed in 489us (4789us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.680414:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9012 00000100:00100000:3.0:1769074914.683452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000001:00080000:3.0:1769074914.694764:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968891 is committed 00000100:00100000:3.0:1769074914.696390:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615980288 00000100:00100000:3.0:1769074914.696404:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615980288 00000100:00100000:3.0:1769074914.696480:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2579 00000100:00100000:3.0:1769074914.696506:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+126:2420:x1855007615980288:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.696526:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.696574:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e289f5 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074914.696599:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074914.696619:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.696622:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.696631:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 127 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.696650:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 127 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074914.696664:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074914.696903:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+127:2420:x1855007615980288:12345-192.168.204.32@tcp:101:cp.0 Request processed in 399us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074914.696911:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2579 00000100:00100000:3.0:1769074914.720226:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615980544 00000100:00100000:3.0:1769074914.720239:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615980544 00010000:00010000:3.0:1769074914.720311:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 128 pid: 8625 timeout: 2004 lvb_type: 1 00000100:00100000:3.0:1769074914.720368:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1818 00000100:00100000:3.0:1769074914.720380:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+128:2420:x1855007615980544:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074914.720403:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074914.720429:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 128 pid: 8625 timeout: 2004 lvb_type: 1 00010000:00010000:3.0:1769074914.720446:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 128 pid: 8625 timeout: 2004 lvb_type: 1 00010000:00010000:3.0:1769074914.720476:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe6c24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289f5 expref: 128 pid: 8625 timeout: 2004 lvb_type: 1 00010000:00010000:3.0:1769074914.720505:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.720507:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074914.720518:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e247e00/0x557988ac98fe6c2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289fc expref: 127 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.720595:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e247e00/0x557988ac98fe6c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289fc expref: 127 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.720647:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e247e00/0x557988ac98fe6c2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e289fc expref: 127 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074914.720667:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626600960:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074914.720759:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614b9afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074914.729181:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626600960:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074914.729211:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074914.839617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.864045:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615981312 00000100:00100000:3.0:1769074914.864056:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615981312 00000100:00100000:3.0:1769074914.864115:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:3.0:1769074914.864124:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2417:x1855007615981312:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074914.864161:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.864181:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28a49 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.864237:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.864252:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864263:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864278:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074914.864285:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864292:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864354:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864361:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864367:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864374:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.864379:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864387:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864400:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.864403:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.864408:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864414:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6c78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864426:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864431:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864437:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864442:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.864445:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864450:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864457:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604f17d600) 00010000:00010000:3.0:1769074914.864459:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.864462:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864467:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6c7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074914.864504:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c71 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a49 expref: 249 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.864514:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.864516:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074914.864519:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a49 expref: 249 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.864733:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc -2) 00000100:00100000:3.0:1769074914.864814:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2417:x1855007615981312:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 690us (929us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074914.864822:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:3.0:1769074914.869347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074914.887106:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615981568 00000100:00100000:3.0:1769074914.887118:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615981568 00000100:00100000:3.0:1769074914.887179:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9017 00000100:00100000:3.0:1769074914.887189:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:66958:x1855007615981568:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.887209:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.887229:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c9b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28a57 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.887298:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.887316:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887339:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887354:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.887359:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887365:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887579:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887587:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887592:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887597:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.887601:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887608:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887619:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.887622:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.887627:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887633:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ca2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887645:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887651:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887656:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887660:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.887663:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887668:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887674:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x25a697b1 (ffff91604f17d600) 00010000:00010000:3.0:1769074914.887677:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.887679:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887684:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ca9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.887714:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c9b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a57 expref: 249 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.887723:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.887726:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.887729:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6c9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a57 expref: 249 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.887737:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074914.887838:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:66958:x1855007615981568:12345-192.168.204.32@tcp:101:cp.0 Request processed in 650us (833us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.887845:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9017 00000100:00100000:3.0:1769074914.895965:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615981696 00000100:00100000:3.0:1769074914.895975:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615981696 00000100:00100000:3.0:1769074914.896036:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9018 00000100:00100000:3.0:1769074914.896044:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:66958:x1855007615981696:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074914.896061:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074914.896079:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6cb0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28a5e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.896134:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.896145:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896153:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896163:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074914.896167:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896171:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896213:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896217:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896221:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896225:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.896227:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896232:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896239:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.896242:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.896244:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896249:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6cb7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896256:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896259:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896263:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896265:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074914.896267:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896271:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896274:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x25a697b1 (ffff91604f17d600) 00010000:00010000:3.0:1769074914.896276:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.896277:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896280:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6cbe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074914.896302:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6cb0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a5e expref: 249 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.896308:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074914.896309:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074914.896311:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6cb0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28a5e expref: 249 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074914.896316:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074914.896733:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:66958:x1855007615981696:12345-192.168.204.32@tcp:101:cp.0 Request processed in 687us (1009us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074914.896742:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9018 00000100:00100000:3.0:1769074914.939671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074915.003982:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1769074915.025926:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074915.034954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.086287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.086376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074915.114974:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074915.162473:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615984512 00000100:00100000:3.0:1769074915.162502:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615984512 00000100:00100000:3.0:1769074915.162625:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:3.0:1769074915.162637:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:2418:x1855007615984512:12345-192.168.204.32@tcp:63:ll_sa.0 00000100:00100000:3.0:1769074915.199285:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615985024 00000100:00100000:3.0:1769074915.199301:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615985024 00000100:00100000:3.0:1769074915.199384:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9028 00000100:00100000:3.0:1769074915.199397:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:66973:x1855007615985024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074915.199425:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.199453:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6e0e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28b6f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.199990:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.200012:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200026:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200042:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.200050:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200057:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200138:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200146:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200153:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200160:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.200166:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200175:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200189:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.200193:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.200200:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200206:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6e15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200223:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200228:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200234:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200239:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.200243:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200249:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200256:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfe8f7efb (ffff91604f17d600) 00010000:00010000:3.0:1769074915.200259:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.200262:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200268:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6e1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.200310:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6e0e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28b6f expref: 257 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.200332:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.200334:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.200338:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6e0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28b6f expref: 257 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.200348:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.200505:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:66973:x1855007615985024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1099us (1390us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.200514:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9028 00000100:00100000:3.0:1769074915.214973:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.231673:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1769074915.232803:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074915.318693:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615986688 00000100:00100000:3.0:1769074915.318708:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615986688 00000100:00100000:3.0:1769074915.318783:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9034 00000100:00100000:3.0:1769074915.318794:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:66979:x1855007615986688:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074915.318821:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.318847:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ebd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28bae expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.319063:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.319080:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319094:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319109:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.319116:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319123:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319189:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319197:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319203:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319210:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.319215:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319223:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319237:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.319241:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.319248:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319254:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ec4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319267:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319273:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319278:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319282:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.319285:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319290:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319297:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8433e308 (ffff91604f17d600) 00010000:00010000:3.0:1769074915.319300:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.319302:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319313:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ecb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.319360:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ebd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bae expref: 262 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.319372:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.319374:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.319378:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ebd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bae expref: 262 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.319387:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.319511:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:66979:x1855007615986688:12345-192.168.204.32@tcp:101:rm.0 Request processed in 718us (1052us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.319519:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9034 00000100:00100000:3.0:1769074915.335748:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615986816 00000100:00100000:3.0:1769074915.335763:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615986816 00000100:00100000:3.0:1769074915.335843:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9035 00000100:00100000:3.0:1769074915.335855:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:66980:x1855007615986816:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.335882:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.335909:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ed2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28bb5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.336010:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.336028:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336044:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336060:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.336066:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336072:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336138:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336146:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336153:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336160:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.336164:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336172:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336186:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.336190:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.336195:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336201:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6ed9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336217:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336223:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336229:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336234:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.336237:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336243:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336250:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8433e308 (ffff91604f17d600) 00010000:00010000:3.0:1769074915.336252:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.336256:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336261:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6ee0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.336296:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ed2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bb5 expref: 262 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.336307:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.336309:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.336324:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6ed2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bb5 expref: 262 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.336338:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.336417:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:66980:x1855007615986816:12345-192.168.204.32@tcp:101:cp.0 Request processed in 564us (825us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.336425:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9035 00000100:00100000:3.0:1769074915.346168:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615987200 00000100:00100000:3.0:1769074915.346182:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615987200 00000100:00100000:3.0:1769074915.346255:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9037 00000100:00100000:3.0:1769074915.346267:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:66980:x1855007615987200:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.346297:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.346336:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6efc lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28bc3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.346596:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.346615:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.346629:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.346645:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8433e308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.346652:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.346658:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074915.347895:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x95:0x0], index 0: 0 00010000:00010000:3.0:1769074915.348137:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe6f11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x134:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074915.348154:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe6f11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348164:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe6f11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348205:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348212:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348219:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348225:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.348229:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348237:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348250:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.348253:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.348258:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348264:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe6f03 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074915.348284:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a658fcb reply state 0000000007c39179 transno 4294968900 ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348296:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074915.348302:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8433e308 (ffff91604f17d600) 00010000:00010000:3.0:1769074915.348304:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074915.348307:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074915.348357:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6efc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bc3 expref: 264 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.348372:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6400/0x557988ac98fe6f11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x134:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bc3 expref: 263 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.348381:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x134:0x0].0x0 (ffff91604f17d900) 00010000:00010000:3.0:1769074915.348384:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074915.348386:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6400, rc 0) 00000100:00100000:3.0:1769074915.348481:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+264:66980:x1855007615987200:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2210us (2679us total) trans 4294968900 rc 0/0 00000100:00100000:3.0:1769074915.349265:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9037 00000100:00100000:3.0:1769074915.356376:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615987456 00000100:00100000:3.0:1769074915.356389:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615987456 00000100:00100000:3.0:1769074915.356452:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2588 00000100:00100000:3.0:1769074915.356462:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+129:66980:x1855007615987456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.356491:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.356512:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044754000/0x557988ac98fe6f26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28bd1 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.356592:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a74800/0x557988ac98fe6f1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bca expref: 130 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.356601:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.356603:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.356607:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044754000/0x557988ac98fe6f26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bd1 expref: 130 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.356646:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a74800/0x557988ac98fe6f1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bca expref: 130 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.356662:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a74800/0x557988ac98fe6f1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bca expref: 130 pid: 8405 timeout: 2004 lvb_type: 1 00000100:00100000:3.0:1769074915.356679:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149867480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626601856:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074915.356796:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044cb89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074915.360148:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149867480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626601856:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074915.360193:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044754000/0x557988ac98fe6f26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bd1 expref: 130 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.360220:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044754000, rc 0) 00000100:00100000:3.0:1769074915.360295:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+130:66980:x1855007615987456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3833us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.360306:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2588 00000100:00100000:3.0:1769074915.365985:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615987840 00000100:00100000:3.0:1769074915.365996:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615987840 00000100:00100000:3.0:1769074915.366051:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1807 00000100:00100000:3.0:1769074915.366060:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+264:66980:x1855007615987840:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074915.366382:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:66980:x1855007615987840:12345-192.168.204.32@tcp:35:cp.0 Request processed in 322us (979us total) trans 4294968901 rc 0/0 00000100:00100000:3.0:1769074915.366389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1807 00000100:00100000:3.0:1769074915.449771:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615988480 00000100:00100000:3.0:1769074915.449785:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615988480 00000100:00100000:3.0:1769074915.449863:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9041 00000100:00100000:3.0:1769074915.449875:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:66985:x1855007615988480:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.449902:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.449940:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe6f81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28bf4 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.450030:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.450048:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450062:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450080:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.450088:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450094:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450165:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450172:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450178:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450185:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.450190:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450197:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450210:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.450214:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.450220:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450226:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe6f88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450242:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450247:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450253:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450258:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.450261:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450267:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450273:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdacd11be (ffff91604f17d500) 00010000:00010000:3.0:1769074915.450275:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.450277:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450282:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe6f8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.450331:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe6f81 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bf4 expref: 266 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.450344:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.450346:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.450350:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe6f81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28bf4 expref: 266 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.450359:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755a00, rc 0) 00000100:00100000:3.0:1769074915.450442:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:66985:x1855007615988480:12345-192.168.204.32@tcp:101:cp.0 Request processed in 569us (1022us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.450451:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9041 00000100:00100000:3.0:1769074915.467504:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615988992 00000100:00100000:3.0:1769074915.467519:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615988992 00000100:00100000:3.0:1769074915.467617:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2589 00000100:00100000:3.0:1769074915.467626:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+127:2418:x1855007615988992:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.467655:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.467684:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604daa6600/0x557988ac98fe6fce lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c09 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074915.467715:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074915.467744:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.467747:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.467758:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604daa6600/0x557988ac98fe6fce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c09 expref: 128 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.467779:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604daa6600/0x557988ac98fe6fce lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c09 expref: 128 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.467795:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.467865:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+128:2418:x1855007615988992:12345-192.168.204.32@tcp:101:cp.0 Request processed in 239us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.467873:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2589 00000100:00100000:3.0:1769074915.535963:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615989888 00000100:00100000:3.0:1769074915.535974:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615989888 00000100:00100000:3.0:1769074915.536034:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:3.0:1769074915.536044:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2420:x1855007615989888:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074915.536087:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.536108:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7006 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c25 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.536171:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074915.536192:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536203:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536221:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074915.536228:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536234:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536294:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536302:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536318:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536326:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.536330:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536338:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536351:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.536354:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.536360:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536366:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe700d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536381:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536387:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536392:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536397:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.536399:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536405:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536411:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff91604f17da00) 00010000:00010000:3.0:1769074915.536414:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.536416:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536422:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755a00/0x557988ac98fe7014 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.536454:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7006 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c25 expref: 270 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.536463:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.536467:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074915.536471:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7006 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c25 expref: 270 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.537849:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc -2) 00000100:00100000:3.0:1769074915.538373:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2420:x1855007615989888:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2323us (2504us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074915.538387:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:3.0:1769074915.586027:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615990784 00000100:00100000:3.0:1769074915.586041:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615990784 00000100:00100000:3.0:1769074915.586151:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2592 00000100:00100000:3.0:1769074915.586163:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+130:66990:x1855007615990784:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.586188:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.586213:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044755a00/0x557988ac98fe7084 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c4f expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.586254:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a74e00/0x557988ac98fe707d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c48 expref: 131 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.586263:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.586265:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.586269:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044755a00/0x557988ac98fe7084 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c4f expref: 131 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.586324:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a74e00/0x557988ac98fe707d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c48 expref: 131 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.586341:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a74e00/0x557988ac98fe707d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c48 expref: 131 pid: 8405 timeout: 2004 lvb_type: 1 00000100:00100000:3.0:1769074915.586356:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149867480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626602368:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074915.638910:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615991424 00000100:00100000:3.0:1769074915.638936:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615991424 00000100:00100000:3.0:1769074915.639019:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9051 00000100:00100000:3.0:1769074915.639031:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66994:x1855007615991424:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074915.639065:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.639094:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe70a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c5d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.639190:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.639208:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639221:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639237:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.639244:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639250:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639336:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639347:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639353:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639359:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.639365:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639372:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639388:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.639391:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.639397:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639403:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639419:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639425:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639432:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639436:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.639439:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639448:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639454:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd17db4c (ffff91604f17da00) 00010000:00010000:3.0:1769074915.639456:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.639459:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639464:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.639499:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe70a0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c5d expref: 274 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.639510:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.639513:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.639516:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe70a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c5d expref: 274 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.639526:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755c00, rc 0) 00000100:00100000:3.0:1769074915.639684:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66994:x1855007615991424:12345-192.168.204.32@tcp:101:rm.0 Request processed in 653us (896us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.639695:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9051 00000100:00100000:3.0:1769074915.675251:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615991936 00000100:00100000:3.0:1769074915.675268:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615991936 00000100:00100000:3.0:1769074915.675351:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9054 00000100:00100000:3.0:1769074915.675362:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66995:x1855007615991936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.675389:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.675417:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c79 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.675558:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.675577:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675593:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675613:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.675620:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675627:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675701:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675709:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675716:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675722:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.675727:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675735:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675751:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.675754:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.675760:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675766:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe70fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675780:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675787:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675793:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675799:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.675801:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675808:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675815:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd17db4c (ffff91604f17da00) 00010000:00010000:3.0:1769074915.675818:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.675821:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675827:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7102 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.675866:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70f4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c79 expref: 274 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.675877:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.675880:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.675884:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe70f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c79 expref: 274 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.675894:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.676282:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66995:x1855007615991936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 920us (1442us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.676293:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9054 00000100:00100000:3.0:1769074915.684825:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615992192 00000100:00100000:3.0:1769074915.684839:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615992192 00000100:00100000:3.0:1769074915.684909:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9055 00000100:00100000:3.0:1769074915.684932:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:66995:x1855007615992192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.684960:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.684988:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7109 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28c80 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.685153:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.685172:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685186:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685203:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.685214:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685220:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074915.685678:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x97:0x0], index 1: 0 00010000:00010000:3.0:1769074915.685869:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de05200/0x557988ac98fe711e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x137:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.685879:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de05200/0x557988ac98fe711e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685888:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de05200/0x557988ac98fe711e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685934:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685941:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685949:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685955:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.685959:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685967:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685982:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.685987:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.685992:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.685998:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7110 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074915.686012:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0195a13 reply state 00000000a972771a transno 4294968906 ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.686023:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.686029:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd17db4c (ffff91604f17d400) 00010000:00010000:3.0:1769074915.686032:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074915.686035:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074915.686075:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7109 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c80 expref: 276 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.686091:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de05200/0x557988ac98fe711e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x137:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c80 expref: 275 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.686099:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x137:0x0].0x0 (ffff91604f17de00) 00010000:00010000:3.0:1769074915.686102:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074915.686105:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de05200, rc 0) 00000100:00100000:3.0:1769074915.686199:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+276:66995:x1855007615992192:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1281us (1482us total) trans 4294968906 rc 0/0 00000100:00100000:3.0:1769074915.686209:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9055 00000100:00100000:3.0:1769074915.698645:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615992576 00000100:00100000:3.0:1769074915.698657:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615992576 00010000:00010000:3.0:1769074915.698727:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe712c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c87 expref: 131 pid: 8625 timeout: 2005 lvb_type: 1 00000100:00100000:3.0:1769074915.698772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1825 00000100:00100000:3.0:1769074915.698783:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+131:2419:x1855007615992576:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074915.698801:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074915.698828:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe712c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c87 expref: 131 pid: 8625 timeout: 2005 lvb_type: 1 00010000:00010000:3.0:1769074915.698844:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe712c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c87 expref: 131 pid: 8625 timeout: 2005 lvb_type: 1 00010000:00010000:3.0:1769074915.698876:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.698878:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.698887:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f16dc00/0x557988ac98fe7133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c8e expref: 131 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.698898:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f16dc00/0x557988ac98fe7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c8e expref: 131 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.698960:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f16dc00/0x557988ac98fe7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28c8e expref: 131 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074915.698976:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149867480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626602752:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074915.699679:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151f9e480 going to sleep for 11 seconds 00000100:00100000:3.0:1769074915.714981:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149867480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626602752:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074915.715023:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074915.759759:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615993216 00000100:00100000:3.0:1769074915.759775:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615993216 00000100:00100000:3.0:1769074915.759895:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:3.0:1769074915.759910:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2418:x1855007615993216:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074915.760009:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.760037:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe714f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28ca3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.760124:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074915.760143:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760156:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760176:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074915.760184:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760190:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760260:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760268:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760276:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760288:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9161819fc600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.760294:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760302:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760340:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.760344:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.760351:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760357:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7156 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760371:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760376:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760381:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760386:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.760390:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760395:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760402:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff91604f17da00) 00010000:00010000:3.0:1769074915.760405:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.760408:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760413:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe715d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074915.760448:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe714f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ca3 expref: 278 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.760458:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.760460:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074915.760463:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe714f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ca3 expref: 278 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.760484:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc -2) 00000100:00100000:3.0:1769074915.760627:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2418:x1855007615993216:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 719us (1116us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074915.760637:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:3.0:1769074915.770340:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626604800 00000100:00100000:3.0:1769074915.770346:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626604800 00000100:00100000:3.0:1769074915.770380:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1769074915.770388:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1855007626604800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074915.770411:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 57344 granted 484937536 pending 0 free 3915657216 avail 3684134912 00000100:00100000:3.0:1769074915.770451:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1855007626604800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.770457:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1769074915.770833:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615993344 00000100:00100000:3.0:1769074915.770838:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615993344 00000100:00100000:3.0:1769074915.770878:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9058 00000100:00100000:3.0:1769074915.770885:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:67000:x1855007615993344:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074915.770900:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.771326:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7179 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28cdb expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.771418:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.771435:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771448:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771464:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074915.771481:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771488:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771603:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771611:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771618:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771624:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.771629:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771642:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771656:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.771659:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.771665:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771671:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe7180 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771687:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771693:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771699:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771704:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.771708:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771714:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771721:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3ee4d1be (ffff91604f17df00) 00010000:00010000:3.0:1769074915.771724:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.771726:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771731:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe7187 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074915.771771:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7179 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28cdb expref: 278 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.771781:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.771783:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.771786:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7179 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28cdb expref: 278 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.771795:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074915.771852:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:67000:x1855007615993344:12345-192.168.204.32@tcp:101:rm.0 Request processed in 966us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.771860:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9058 00000100:00100000:3.0:1769074915.773675:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626603264:0@lo:400:kworker.0 00000100:00100000:3.0:1769074915.784221:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626604288:0@lo:400:kworker.0 00000100:00100000:3.0:1769074915.784271:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626604544 00000100:00100000:3.0:1769074915.784280:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626604544 00000100:00100000:3.0:1769074915.784481:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1769074915.784778:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074915.784892:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626604544:12345-0@lo:400:kworker.0 Request processed in 400us (10896us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.784901:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1769074915.792108:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615993600 00000100:00100000:3.0:1769074915.792122:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615993600 00000100:00100000:3.0:1769074915.792210:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:3.0:1769074915.792221:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007615993600:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074915.792300:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.792338:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe718e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28ce9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.792418:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.792438:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792452:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792481:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.792488:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792508:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792602:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792609:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792616:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792623:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.792628:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792639:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792653:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.792656:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.792662:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792669:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7195 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792685:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792691:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792696:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792700:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.792703:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792708:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792715:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff91604f17df00) 00010000:00010000:3.0:1769074915.792717:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.792720:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792726:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe719c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.792766:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe718e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ce9 expref: 278 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.792775:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.792778:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074915.792782:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6600/0x557988ac98fe718e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ce9 expref: 278 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.792790:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc -2) 00000100:00100000:3.0:1769074915.792885:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007615993600:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 665us (943us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074915.792895:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:3.0:1769074915.805692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.812416:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615994112 00000100:00100000:3.0:1769074915.812429:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615994112 00000100:00100000:3.0:1769074915.812827:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2595 00000100:00100000:3.0:1769074915.812841:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+130:2419:x1855007615994112:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.812866:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.812893:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28d2f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074915.813008:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074915.813037:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.813040:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.813051:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 131 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.813079:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 131 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.813093:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755c00, rc 0) 00000100:00100000:3.0:1769074915.813173:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+131:2419:x1855007615994112:12345-192.168.204.32@tcp:101:cp.0 Request processed in 336us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.813180:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2595 00000100:00100000:3.0:1769074915.817401:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615994240 00000100:00100000:3.0:1769074915.817415:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615994240 00000100:00100000:3.0:1769074915.817496:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2596 00000100:00100000:3.0:1769074915.817507:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+131:67003:x1855007615994240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.817576:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.817607:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe71f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28d36 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.817652:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 132 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.817661:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.817663:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.817668:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe71f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d36 expref: 132 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.817712:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 132 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.817735:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 132 pid: 25313 timeout: 2005 lvb_type: 1 00000100:00100000:3.0:1769074915.817752:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626604928:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074915.817884:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151f9e480 going to sleep for 11 seconds 00010000:00010000:3.0:1769074915.822630:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916044755c00/0x557988ac98fe71f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d2f expref: 133 pid: 25313 timeout: 2005 lvb_type: 1 00000100:00100000:3.0:1769074915.822650:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626604928:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074915.822682:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604daa6600/0x557988ac98fe71f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28d36 expref: 132 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.822695:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6600, rc 0) 00000100:00100000:3.0:1769074915.822767:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+132:67003:x1855007615994240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5260us (5659us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.822778:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2596 00000100:00100000:3.0:1769074915.866745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.885084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.885138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.906320:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615995392 00000100:00100000:3.0:1769074915.906336:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615995392 00000100:00100000:3.0:1769074915.906409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9065 00000100:00100000:3.0:1769074915.906421:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:67014:x1855007615995392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.906449:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.906487:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7267 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28dc2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.906637:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074915.906657:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906672:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906690:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074915.906697:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906703:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906779:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906787:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906793:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906800:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906807:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044755c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.906811:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906821:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906836:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.906840:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.906847:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe726e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906872:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906878:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906884:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906889:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.906891:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906897:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906904:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1c41c425 (ffff91604f17d000) 00010000:00010000:3.0:1769074915.906905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.906908:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906913:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7275 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074915.906951:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7267 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28dc2 expref: 282 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.906963:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.906966:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.906970:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7267 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28dc2 expref: 282 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.906979:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074915.907056:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:67014:x1855007615995392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 636us (872us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074915.907065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9065 00000100:00100000:3.0:1769074915.913128:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615995520 00000100:00100000:3.0:1769074915.913140:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615995520 00000100:00100000:3.0:1769074915.913209:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:3.0:1769074915.913221:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:2418:x1855007615995520:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074915.913287:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.913319:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7291 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28dc9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.913381:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.913397:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913408:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913427:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.913434:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913439:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913516:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913525:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913562:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913569:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.913573:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913581:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913594:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.913596:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.913600:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913606:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7298 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913619:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913625:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913630:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913634:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.913637:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913642:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913648:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff91604f17d300) 00010000:00010000:3.0:1769074915.913651:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.913653:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913658:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe729f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.913688:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7291 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28dc9 expref: 282 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.913696:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.913699:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074915.913702:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7291 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28dc9 expref: 282 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.913710:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc -2) 00000100:00100000:3.0:1769074915.913789:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:2418:x1855007615995520:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 571us (2577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074915.913797:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:3.0:1769074915.925803:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615996032 00000100:00100000:3.0:1769074915.925818:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615996032 00000100:00100000:3.0:1769074915.925885:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2597 00000100:00100000:3.0:1769074915.925898:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+129:2420:x1855007615996032:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074915.925933:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.925965:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9161819fc600/0x557988ac98fe72c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28e0f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074915.925992:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074915.926020:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.926023:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074915.926034:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9161819fc600/0x557988ac98fe72c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e0f expref: 130 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.926054:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9161819fc600/0x557988ac98fe72c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e0f expref: 130 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074915.926070:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc 0) 00000100:00100000:3.0:1769074915.926154:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+130:2420:x1855007615996032:12345-192.168.204.32@tcp:101:cp.0 Request processed in 257us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074915.926163:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2597 00000100:00100000:3.0:1769074915.930101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074915.940904:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615996544 00000100:00100000:3.0:1769074915.940930:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615996544 00000100:00100000:3.0:1769074915.941004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1812 00000100:00100000:3.0:1769074915.941016:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181000850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67014:x1855007615996544:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074915.941437:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181000850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:67014:x1855007615996544:12345-192.168.204.32@tcp:35:cp.0 Request processed in 421us (1037us total) trans 4294968911 rc 0/0 00000100:00100000:3.0:1769074915.941445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1812 00000100:00100000:3.0:1769074915.998564:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615997184 00000100:00100000:3.0:1769074915.998571:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615997184 00000100:00100000:3.0:1769074915.998618:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:3.0:1769074915.998626:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:2417:x1855007615997184:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074915.998655:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074915.998667:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe732b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28e6a expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.998703:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.998713:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998723:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998738:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074915.998746:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998752:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998782:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998793:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998799:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998805:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.998808:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998814:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998821:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.998824:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.998826:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998832:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7332 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998840:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998846:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998851:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998856:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074915.998859:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998868:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998874:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916174a68900) 00010000:00010000:3.0:1769074915.998876:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074915.998878:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998884:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7339 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074915.998902:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe732b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e6a expref: 286 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.998909:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074915.998912:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074915.998915:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe732b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e6a expref: 286 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074915.998923:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc -2) 00000100:00100000:3.0:1769074915.998961:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:2417:x1855007615997184:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 336us (1294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074915.998969:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:3.0:1769074916.053118:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626605568:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074916.053151:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074916.053191:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+132:2419:x1855007615998080:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6853us (7436us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074916.053200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1828 00000100:00100000:3.0:1769074916.087683:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615998464 00000100:00100000:3.0:1769074916.087697:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615998464 00000100:00100000:3.0:1769074916.087774:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9074 00000100:00100000:3.0:1769074916.087786:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67027:x1855007615998464:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074916.087813:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.087846:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe739b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28e94 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.087939:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.087958:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.087971:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.087989:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.087996:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088002:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088076:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088085:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088091:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088102:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088108:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.088112:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088121:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088135:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.088139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.088146:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088152:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088170:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088176:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088181:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088186:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9161819fc600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.088189:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088194:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088206:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68900) 00010000:00010000:3.0:1769074916.088209:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.088212:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088217:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.088254:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe739b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e94 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.088265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.088267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.088271:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe739b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28e94 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.088280:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f989200, rc 0) 00000100:00100000:3.0:1769074916.088374:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67027:x1855007615998464:12345-192.168.204.32@tcp:101:bash.0 Request processed in 590us (918us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.088382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9074 00000100:00100000:3.0:1769074916.115365:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615998848 00000100:00100000:3.0:1769074916.115382:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615998848 00000100:00100000:3.0:1769074916.115501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9076 00000100:00100000:3.0:1769074916.115514:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67028:x1855007615998848:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074916.115581:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.115608:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28ea9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.115710:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.115729:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115742:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115759:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.115766:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115774:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115843:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115851:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115857:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115863:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115869:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.115874:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115886:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.115899:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.115903:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.115909:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116207:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116226:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116233:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116239:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116244:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.116247:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116253:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116262:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68900) 00010000:00010000:3.0:1769074916.116265:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.116268:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73e8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.116326:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73da lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ea9 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.116339:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.116342:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.116345:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ea9 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.116356:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc 0) 00000100:00100000:3.0:1769074916.116444:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67028:x1855007615998848:12345-192.168.204.32@tcp:101:rm.0 Request processed in 932us (1220us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.116453:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9076 00000100:00100000:3.0:1769074916.135935:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615998976 00000100:00100000:3.0:1769074916.135950:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615998976 00000100:00100000:3.0:1769074916.136027:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9077 00000100:00100000:3.0:1769074916.136038:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67029:x1855007615998976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.136065:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.136094:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28eb0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.136187:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.136205:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136219:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136240:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.136247:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136253:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136351:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136360:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136366:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136373:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136379:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.136384:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136393:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.136416:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.136423:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136429:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe73f6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136449:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136455:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136932:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136937:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9161819fc600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.136940:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136946:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136955:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68900) 00010000:00010000:3.0:1769074916.136958:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.136961:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.136967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe73fd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.137017:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73ef lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eb0 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.137030:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.137032:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.137036:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe73ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eb0 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.137051:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074916.137140:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67029:x1855007615998976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1103us (1337us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.137149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9077 00000100:00100000:3.0:1769074916.150135:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615999104 00000100:00100000:3.0:1769074916.150161:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615999104 00000100:00100000:3.0:1769074916.150346:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9078 00000100:00100000:3.0:1769074916.150358:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67029:x1855007615999104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.150389:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.150418:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7404 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28eb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.150551:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.150569:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150582:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150599:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.150606:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150614:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150690:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150698:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150705:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150711:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150718:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.150723:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150732:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150747:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.150751:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.150757:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150763:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe740b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150779:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150786:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150791:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150797:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.150800:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150807:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150815:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68900) 00010000:00010000:3.0:1769074916.150817:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.150820:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7412 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.150860:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7404 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eb7 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.150871:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.150874:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.150878:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7404 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eb7 expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.150888:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc 0) 00000100:00100000:3.0:1769074916.150993:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67029:x1855007615999104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 636us (6518us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.151002:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9078 00000100:00100000:3.0:1769074916.156272:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615999360 00000100:00100000:3.0:1769074916.156310:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615999360 00000100:00100000:3.0:1769074916.156387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9079 00000100:00100000:3.0:1769074916.156398:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:67029:x1855007615999360:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.156427:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.156462:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7419 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28ebe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.156657:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.156677:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.156691:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.156709:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.156716:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.156723:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074916.157191:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x99:0x0], index 1: 0 00010000:00010000:3.0:1769074916.157402:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe742e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.157414:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe742e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157422:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe742e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157467:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157474:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157481:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157488:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157494:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.157499:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157507:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157522:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.157525:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.157565:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157572:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe7420 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074916.157587:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008707cd8f reply state 0000000037331ff8 transno 4294968914 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157599:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.157605:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68600) 00010000:00010000:3.0:1769074916.157608:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074916.157611:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074916.157650:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7419 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ebe expref: 292 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.157666:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044755c00/0x557988ac98fe742e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ebe expref: 291 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.157674:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13b:0x0].0x0 (ffff916174a68800) 00010000:00010000:3.0:1769074916.157676:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074916.157679:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044755c00, rc 0) 00000100:00100000:3.0:1769074916.157773:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67029:x1855007615999360:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1376us (1608us total) trans 4294968914 rc 0/0 00000100:00100000:3.0:1769074916.157781:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9079 00000100:00100000:3.0:1769074916.176291:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007615999744 00000100:00100000:3.0:1769074916.176311:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007615999744 00010000:00010000:3.0:1769074916.176379:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7200/0x557988ac98fe743c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ec5 expref: 132 pid: 8625 timeout: 2005 lvb_type: 1 00000100:00100000:3.0:1769074916.176429:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1829 00000100:00100000:3.0:1769074916.176438:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+132:2419:x1855007615999744:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074916.176455:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074916.176495:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7200/0x557988ac98fe743c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ec5 expref: 132 pid: 8625 timeout: 2005 lvb_type: 1 00010000:00010000:3.0:1769074916.176511:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7200/0x557988ac98fe743c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ec5 expref: 132 pid: 8625 timeout: 2005 lvb_type: 1 00010000:00010000:3.0:1769074916.176852:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7200/0x557988ac98fe743c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ec5 expref: 132 pid: 8625 timeout: 2005 lvb_type: 1 00010000:00010000:3.0:1769074916.176873:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.176876:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.176884:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7a00/0x557988ac98fe7443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ecc expref: 131 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.176897:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7a00/0x557988ac98fe7443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ecc expref: 131 pid: 8625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074916.185366:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616000000 00000100:00100000:3.0:1769074916.185380:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616000000 00000100:00100000:3.0:1769074916.185454:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1814 00000100:00100000:3.0:1769074916.185477:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67029:x1855007616000000:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074916.185936:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67029:x1855007616000000:12345-192.168.204.32@tcp:35:cp.0 Request processed in 460us (1311us total) trans 4294968915 rc 0/0 00000100:00100000:3.0:1769074916.185946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1814 00000100:00100000:3.0:1769074916.278403:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626606080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1769074916.304527:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616000256 00000100:00100000:3.0:1769074916.304574:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616000256 00000100:00100000:3.0:1769074916.304647:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9081 00000100:00100000:3.0:1769074916.304658:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67034:x1855007616000256:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074916.304683:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.304706:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7474 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28eda expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.304785:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.304800:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304813:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304829:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.304836:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304843:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304923:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304932:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304938:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304945:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304952:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.304958:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304970:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.304985:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.304990:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.304996:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe747b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305010:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305017:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305022:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305039:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9161819fc600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.305042:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305048:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305055:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff916174a68900) 00010000:00010000:3.0:1769074916.305057:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.305060:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305065:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe7482 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.305099:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7474 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eda expref: 294 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.305108:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.305111:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.305114:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7474 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28eda expref: 294 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.305123:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:3.0:1769074916.305190:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67034:x1855007616000256:12345-192.168.204.32@tcp:101:rm.0 Request processed in 534us (4308us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.305197:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9081 00000100:00100000:3.0:1769074916.327442:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616000640 00000100:00100000:3.0:1769074916.327468:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616000640 00000100:00100000:3.0:1769074916.334118:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616000768 00000100:00100000:3.0:1769074916.334133:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616000768 00000100:00100000:3.0:1769074916.334245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9084 00000100:00100000:3.0:1769074916.334259:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67035:x1855007616000768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.334287:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.334325:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe74b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28ef6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.334418:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.334437:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334451:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334484:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.334501:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334509:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334617:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334626:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334633:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334640:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334647:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.334651:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334658:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334672:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.334676:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.334682:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334688:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe74ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334706:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334712:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334717:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334721:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.334724:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334729:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff916174a68900) 00010000:00010000:3.0:1769074916.334738:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.334740:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334745:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe74c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.334781:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe74b3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ef6 expref: 294 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.334792:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.334794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.334798:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe74b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28ef6 expref: 294 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.334813:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc 0) 00000100:00100000:3.0:1769074916.334897:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67035:x1855007616000768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 641us (905us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.334905:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9084 00000100:00100000:3.0:1769074916.339160:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616001024 00000100:00100000:3.0:1769074916.339172:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616001024 00000100:00100000:3.0:1769074916.339288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9085 00000100:00100000:3.0:1769074916.339312:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:67035:x1855007616001024:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.339340:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.339368:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe74c8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28efd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.339609:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.339628:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.339641:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.339660:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x7505fae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.339668:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.339674:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074916.340096:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x99:0x0], index 0: 0 00010000:00010000:3.0:1769074916.340288:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe74dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.340993:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe74dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341008:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe74dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341065:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341072:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341078:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341086:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341092:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.341096:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341104:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341118:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.341121:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.341127:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341137:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe74cf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074916.341157:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000039ffc7ac reply state 000000007daf7d33 transno 4294968916 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341168:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.341173:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff916174a68a00) 00010000:00010000:3.0:1769074916.341175:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074916.341179:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074916.341224:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe74c8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28efd expref: 296 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.341240:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8bc00/0x557988ac98fe74dd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28efd expref: 295 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.341248:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13c:0x0].0x0 (ffff916174a68400) 00010000:00010000:3.0:1769074916.341251:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074916.341253:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8bc00, rc 0) 00000100:00100000:3.0:1769074916.341365:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67035:x1855007616001024:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2065us (2317us total) trans 4294968916 rc 0/0 00000100:00100000:3.0:1769074916.341375:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9085 00000100:00100000:3.0:1769074916.352636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074916.410788:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616001792 00000100:00100000:3.0:1769074916.410802:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616001792 00000100:00100000:3.0:1769074916.410882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9086 00000100:00100000:3.0:1769074916.410894:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67038:x1855007616001792:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074916.410934:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.410965:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe74f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.411062:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.411080:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411093:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411109:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.411115:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411121:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411193:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411200:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411206:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411213:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411218:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.411224:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411232:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411245:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.411249:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.411254:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411260:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7500 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411274:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411280:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411285:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411290:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.411294:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411311:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411318:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff916174a68900) 00010000:00010000:3.0:1769074916.411321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.411323:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411333:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7507 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.411370:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe74f9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f12 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.411381:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.411384:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.411388:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe74f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f12 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.411397:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ae00, rc 0) 00000100:00100000:3.0:1769074916.412310:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67038:x1855007616001792:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1398us (1805us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.412324:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9086 00000100:00100000:3.0:1769074916.428866:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616001920 00000100:00100000:3.0:1769074916.428873:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616001920 00000100:00100000:3.0:1769074916.428929:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9087 00000100:00100000:3.0:1769074916.428936:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67039:x1855007616001920:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074916.428948:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.428960:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7523 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.428999:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.429010:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429022:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429036:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.429043:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429049:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429081:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429087:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429092:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429099:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429103:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.429106:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429112:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429120:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.429122:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.429126:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429132:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe752a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429141:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429147:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429153:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429157:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.429160:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429165:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff916174a68900) 00010000:00010000:3.0:1769074916.429173:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.429175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7531 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.429199:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7523 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f19 expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.429206:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.429209:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.429213:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7523 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f19 expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.429227:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074916.429273:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67039:x1855007616001920:12345-192.168.204.32@tcp:101:rm.0 Request processed in 338us (1538us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.429281:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9087 00000100:00100000:3.0:1769074916.459580:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616002304 00000100:00100000:3.0:1769074916.459593:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616002304 00000100:00100000:3.0:1769074916.459675:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9089 00000100:00100000:3.0:1769074916.459687:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67040:x1855007616002304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.459717:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.459748:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe754d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.459845:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.459864:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459876:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459891:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.459897:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459902:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459979:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459986:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459992:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.459998:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460005:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.460009:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460016:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460030:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.460033:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.460038:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460043:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7554 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460059:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460065:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460070:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460076:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.460078:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460085:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460091:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff916174a68900) 00010000:00010000:3.0:1769074916.460093:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.460096:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460100:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe755b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.460135:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe754d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f2e expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.460146:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.460149:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.460152:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe754d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f2e expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.460162:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ae00, rc 0) 00000100:00100000:3.0:1769074916.460253:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67040:x1855007616002304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 566us (829us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.460261:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9089 00000100:00100000:3.0:1769074916.475129:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616002688 00000100:00100000:3.0:1769074916.475146:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616002688 00000100:00100000:3.0:1769074916.475217:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9091 00000100:00100000:3.0:1769074916.475229:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67040:x1855007616002688:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.475255:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.475281:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7577 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f3c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.475451:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.475471:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.475485:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.475503:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb98d164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.475511:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.475518:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074916.476221:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x9a:0x0], index 1: 0 00010000:00010000:3.0:1769074916.477327:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe758c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.477351:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe758c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477361:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe758c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477418:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477425:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477431:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477438:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477444:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.477449:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477457:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477471:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.477474:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.477479:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477485:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe757e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074916.477520:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006c68d56 reply state 00000000e7ac4d5e transno 4294968918 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477554:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.477560:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff916174a68900) 00010000:00010000:3.0:1769074916.477564:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074916.477567:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074916.477616:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7577 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f3c expref: 300 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.477633:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9161819fc600/0x557988ac98fe758c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f3c expref: 299 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.477641:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13d:0x0].0x0 (ffff916174a68e00) 00010000:00010000:3.0:1769074916.477643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074916.477646:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9161819fc600, rc 0) 00000100:00100000:3.0:1769074916.478171:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67040:x1855007616002688:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2940us (3495us total) trans 4294968918 rc 0/0 00000100:00100000:3.0:1769074916.478183:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9091 00000100:00100000:3.0:1769074916.485890:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616002816 00000100:00100000:3.0:1769074916.485914:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616002816 00000100:00100000:3.0:1769074916.485989:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2605 00000100:00100000:3.0:1769074916.486000:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+131:2418:x1855007616002816:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.486022:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.486048:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe759a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f43 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074916.486079:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074916.486106:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.486108:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.486119:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe759a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f43 expref: 132 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074916.486139:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604daa6e00/0x557988ac98fe759a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f43 expref: 132 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074916.486154:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074916.486229:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+132:2418:x1855007616002816:12345-192.168.204.32@tcp:101:cp.0 Request processed in 230us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074916.486236:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2605 00000100:00100000:3.0:1769074916.579067:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616003456 00000100:00100000:3.0:1769074916.579083:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616003456 00000100:00100000:3.0:1769074916.579164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9092 00000100:00100000:3.0:1769074916.579176:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67043:x1855007616003456:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074916.579203:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.579231:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.579335:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.579354:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579368:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579386:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.579395:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579401:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579493:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579500:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579505:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579512:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579517:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.579522:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579561:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579577:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.579581:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.579587:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579593:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe75af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579609:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579616:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579620:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579626:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.579629:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579634:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579640:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc9cf38bf (ffff916174a68300) 00010000:00010000:3.0:1769074916.579643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.579646:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579650:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.579687:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75a8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f51 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.579697:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.579700:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.579703:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f51 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.579715:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074916.579802:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67043:x1855007616003456:12345-192.168.204.32@tcp:101:bash.0 Request processed in 628us (1319us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.579811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9092 00010000:00010000:1.0:1769074916.601239:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.601242:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe75e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.601247:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe75e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.601253:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff91604f42a600) 00010000:00010000:1.0:1769074916.601255:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.601257:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe75e0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.601262:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe75e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.601282:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe75d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f5f expref: 302 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.601290:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.601304:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074916.601307:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe75d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f5f expref: 302 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.601316:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7c00, rc -2) 00000100:00100000:1.0:1769074916.601385:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:2417:x1855007616003712:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 417us (1985us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074916.601391:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:3.0:1769074916.608891:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616003840 00000100:00100000:3.0:1769074916.608980:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616003840 00000100:00100000:3.0:1769074916.609093:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9094 00000100:00100000:3.0:1769074916.609104:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:67044:x1855007616003840:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074916.609133:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.609160:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.609249:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.609266:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609278:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609306:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.609314:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609320:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609389:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609396:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609402:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609407:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609415:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.609419:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609427:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609440:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.609443:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.609448:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609464:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe75ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609481:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609487:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609504:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609509:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.609512:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609518:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc9cf38bf (ffff916174a68300) 00010000:00010000:3.0:1769074916.609527:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.609558:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609564:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.609598:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f66 expref: 302 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.609609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.609611:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.609615:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe75e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f66 expref: 302 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.609625:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074916.609720:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:67044:x1855007616003840:12345-192.168.204.32@tcp:101:rm.0 Request processed in 616us (969us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.609728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9094 00000100:00100000:3.0:1769074916.639040:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616003968 00000100:00100000:3.0:1769074916.639056:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616003968 00000100:00100000:3.0:1769074916.639138:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9095 00000100:00100000:3.0:1769074916.639150:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:67045:x1855007616003968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.639179:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.639209:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28f6d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.639309:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.639327:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639341:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639360:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.639367:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639373:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639444:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639451:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639457:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639464:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639470:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.639475:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639484:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.639513:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.639519:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7603 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639585:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639590:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639596:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639601:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.639604:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639610:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639616:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc9cf38bf (ffff916174a68300) 00010000:00010000:3.0:1769074916.639619:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.639622:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.639627:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe760a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.640188:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f6d expref: 302 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.640202:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.640206:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.640210:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe75fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28f6d expref: 302 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.640225:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:3.0:1769074916.640317:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:67045:x1855007616003968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1169us (1668us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074916.640326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9095 00000100:00100000:3.0:1769074916.665774:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616004480 00000100:00100000:3.0:1769074916.665789:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616004480 00000100:00100000:3.0:1769074916.665872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9097 00000100:00100000:3.0:1769074916.665884:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:67045:x1855007616004480:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.665912:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.665940:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe763b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28fb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.666102:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.666121:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666135:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666152:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.666159:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666165:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074916.666696:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9a:0x0], index 0: 0 00010000:00010000:3.0:1769074916.666874:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7650 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074916.666886:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7650 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666894:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7650 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666932:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666939:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666945:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666952:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666958:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.666963:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666970:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.666985:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.666988:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.666993:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.667003:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7642 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074916.667018:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009cb3b30f reply state 00000000e81104b5 transno 4294968920 ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.667031:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074916.667036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc9cf38bf (ffff916174a68300) 00010000:00010000:3.0:1769074916.667038:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074916.667042:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074916.667092:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6e00/0x557988ac98fe763b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fb3 expref: 304 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.667108:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989200/0x557988ac98fe7650 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fb3 expref: 303 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.667115:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13e:0x0].0x0 (ffff91604f17d300) 00010000:00010000:3.0:1769074916.667117:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074916.667120:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f989200, rc 0) 00000100:00100000:3.0:1769074916.667236:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67045:x1855007616004480:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1354us (1831us total) trans 4294968920 rc 0/0 00000100:00100000:3.0:1769074916.667247:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9097 00000100:00100000:3.0:1769074916.679181:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616004736 00000100:00100000:3.0:1769074916.679195:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616004736 00000100:00100000:3.0:1769074916.679271:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2608 00000100:00100000:3.0:1769074916.679282:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+134:67045:x1855007616004736:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074916.679316:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.679343:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604daa6e00/0x557988ac98fe7665 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e28fc1 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.679383:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e247200/0x557988ac98fe765e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fba expref: 135 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074916.679392:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.679394:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074916.679398:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604daa6e00/0x557988ac98fe7665 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fc1 expref: 135 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.679443:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e247200/0x557988ac98fe765e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fba expref: 135 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074916.679471:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e247200/0x557988ac98fe765e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fba expref: 135 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:3.0:1769074916.679489:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f972300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626606720:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074916.679839:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00010000:00010000:3.0:1769074916.684028:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e247200/0x557988ac98fe765e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fba expref: 136 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:3.0:1769074916.684045:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f972300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626606720:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074916.684076:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604daa6e00/0x557988ac98fe7665 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fc1 expref: 135 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.684086:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6e00, rc 0) 00000100:00100000:3.0:1769074916.684120:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:67045:x1855007616004736:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4840us (5108us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074916.684128:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2608 00000100:00100000:3.0:1769074916.691837:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616005120 00000100:00100000:3.0:1769074916.691851:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616005120 00000100:00100000:3.0:1769074916.691931:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1817 00000100:00100000:3.0:1769074916.691943:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67045:x1855007616005120:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074916.692333:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:67045:x1855007616005120:12345-192.168.204.32@tcp:35:cp.0 Request processed in 391us (611us total) trans 4294968921 rc 0/0 00000100:00100000:3.0:1769074916.692341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1817 00000100:00100000:1.0:1769074916.722045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1769074916.722863:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe766c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fc8 expref: 306 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.722873:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.722876:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074916.722880:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe766c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e28fc8 expref: 306 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.722890:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc -2) 00000100:00100000:2.0:1769074916.722968:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2420:x1855007616005248:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 701us (939us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074916.722976:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:2.0:1769074916.740839:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616005376 00000100:00100000:2.0:1769074916.740854:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616005376 00000100:00100000:2.0:1769074916.740936:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9098 00000100:00100000:2.0:1769074916.740949:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67052:x1855007616005376:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074916.740977:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.741005:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7681 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29000 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.741104:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.741123:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741140:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741157:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.741168:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741173:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741245:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741252:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741258:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741264:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.741269:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741277:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741302:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.741306:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.741312:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741318:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe7688 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741333:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741339:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741347:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741352:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.741355:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741360:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741368:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x689dba72 (ffff916052af8400) 00010000:00010000:2.0:1769074916.741370:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.741372:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741377:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe768f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.741415:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7681 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29000 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.741426:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.741429:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.741433:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7681 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29000 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.741443:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc 0) 00000100:00100000:2.0:1769074916.741594:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67052:x1855007616005376:12345-192.168.204.32@tcp:101:bash.0 Request processed in 648us (869us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074916.741602:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9098 00000100:00100000:3.0:1769074916.757359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.759171:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616005504 00000100:00100000:2.0:1769074916.759243:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616005504 00000100:00100000:3.0:1769074916.760317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.760779:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616005632 00000100:00100000:1.0:1769074916.760788:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616005632 00000100:00100000:1.0:1769074916.760832:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:1.0:1769074916.760839:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2420:x1855007616005632:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074916.760892:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.760916:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe76ab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2900e expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.760957:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074916.760967:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.760975:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.760987:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074916.760993:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.760999:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761032:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761038:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761044:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761049:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.761052:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761062:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761071:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.761074:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.761078:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761083:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761096:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761102:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761108:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761113:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.761116:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761122:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761129:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604f42a600) 00010000:00010000:1.0:1769074916.761131:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.761134:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761140:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074916.761162:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe76ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2900e expref: 306 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.761170:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.761172:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074916.761175:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe76ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2900e expref: 306 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.761184:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6200, rc -2) 00000100:00100000:1.0:1769074916.761229:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2420:x1855007616005632:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 390us (944us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074916.761236:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:3.0:1769074916.782338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074916.809504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074916.809613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.809722:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616006016 00000100:00100000:1.0:1769074916.809739:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616006016 00000100:00100000:2.0:1769074916.809770:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616005888 00000100:00100000:2.0:1769074916.809782:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616005888 00000100:00100000:1.0:1769074916.809834:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:2.0:1769074916.809848:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9101 00000100:00100000:1.0:1769074916.809851:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:2418:x1855007616006016:12345-192.168.204.32@tcp:63:ll_sa.0 00000100:00100000:2.0:1769074916.809866:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:67056:x1855007616005888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074916.809890:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.809912:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe76d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2904d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.809937:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.809957:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29054 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.809983:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.810002:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.810013:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074916.810016:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.810044:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.810080:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.810085:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.810098:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.810133:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.810141:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074916.810152:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.810160:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.810186:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.810196:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.810210:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.810211:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.810246:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.810255:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816620:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.816635:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816652:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.816659:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.816678:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.816681:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.816685:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.816692:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fe76e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.816712:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816721:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816722:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816755:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816755:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.816784:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.816788:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816794:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.816795:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816804:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.816811:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816823:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x689dba72 (ffff916052af8400) 00010000:00010000:1.0:1769074916.816824:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe76ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816837:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.816845:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.816853:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe76f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074916.816860:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816870:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816878:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816884:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.816887:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816894:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816904:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604f42a600) 00010000:00010000:1.0:1769074916.816908:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.816912:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.816924:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe76f8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074916.816925:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe76d5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2904d expref: 308 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.816962:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.816967:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.816973:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe76d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2904d expref: 308 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.816986:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc 0) 00010000:00010000:1.0:1769074916.817000:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76dc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29054 expref: 307 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.817014:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.817018:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074916.817024:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe76dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29054 expref: 307 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.821978:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc -2) 00000100:00100000:1.0:1769074916.822362:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2418:x1855007616006016:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 12508us (12738us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074916.822378:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:1.0:1769074916.823852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.824002:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616006144 00000100:00100000:2.0:1769074916.824014:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616006144 00000100:00100000:2.0:1769074916.824097:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9102 00000100:00100000:2.0:1769074916.824108:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:67056:x1855007616006144:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074916.824135:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.824161:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe76ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2908c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.824246:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.824263:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.824277:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.827890:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.828244:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828261:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828358:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828367:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828375:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828382:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.828387:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828396:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828413:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.828416:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.828423:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828429:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe7706 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828462:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828470:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828475:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828480:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.828484:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828490:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828498:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x689dba72 (ffff916052af8a00) 00010000:00010000:2.0:1769074916.828501:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.828505:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828510:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe770d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.828621:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe76ff lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2908c expref: 306 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.828634:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.828637:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.828641:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe76ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2908c expref: 306 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.828659:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36000, rc 0) 00000100:00100000:2.0:1769074916.828769:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:67056:x1855007616006144:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4658us (4926us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074916.828780:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9102 00000100:00100000:1.0:1769074916.852299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074916.858833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.861079:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616006528 00000100:00100000:1.0:1769074916.861111:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616006528 00000100:00100000:1.0:1769074916.861214:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2609 00000100:00100000:1.0:1769074916.861227:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+132:2420:x1855007616006528:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074916.861387:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.861418:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2909a expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074916.861458:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074916.861485:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.861488:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.861500:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2909a expref: 133 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.861522:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2909a expref: 133 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.861566:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:1.0:1769074916.861654:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+133:2420:x1855007616006528:12345-192.168.204.32@tcp:101:cp.0 Request processed in 429us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074916.861662:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2609 00000100:00100000:3.0:1769074916.865556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.866114:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616006656 00000100:00100000:1.0:1769074916.866128:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616006656 00000100:00100000:1.0:1769074916.866266:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2610 00000100:00100000:1.0:1769074916.866373:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+133:67056:x1855007616006656:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074916.866398:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.866422:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe773e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e290a1 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.866471:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2909a expref: 134 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.866481:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.866484:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.866488:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7c00/0x557988ac98fe773e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290a1 expref: 134 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.866669:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2909a expref: 134 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.866687:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2909a expref: 134 pid: 25313 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074916.866705:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626606976:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074916.866842:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044f176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074916.873421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074916.881846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.882204:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007040 00000100:00100000:1.0:1769074916.882213:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007040 00000100:00100000:1.0:1769074916.882275:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1818 00000100:00100000:1.0:1769074916.882285:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181001850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67056:x1855007616007040:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074916.882732:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181001850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67056:x1855007616007040:12345-192.168.204.32@tcp:35:cp.0 Request processed in 447us (900us total) trans 4294968923 rc 0/0 00000100:00100000:1.0:1769074916.882741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1818 00000100:00100000:2.0:1769074916.912250:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.912377:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007168 00000100:00100000:1.0:1769074916.912392:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007168 00000100:00100000:1.0:1769074916.912478:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:1.0:1769074916.912503:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:2417:x1855007616007168:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074916.912626:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.912655:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7745 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e290a8 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.912733:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074916.912752:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912765:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912782:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074916.912790:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912796:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912867:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912875:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912883:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912889:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.912894:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912916:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912932:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.912936:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.912941:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912948:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe774c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912963:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912970:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912976:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912981:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074916.912984:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.912990:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.913002:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604f42a100) 00010000:00010000:1.0:1769074916.913005:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074916.913008:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.913014:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7753 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074916.913047:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7745 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290a8 expref: 310 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.913058:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074916.913060:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074916.913064:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7745 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290a8 expref: 310 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.913076:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6000, rc -2) 00000100:00100000:1.0:1769074916.913170:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:2417:x1855007616007168:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 682us (936us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074916.913179:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:3.0:1769074916.934286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.934733:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007296 00000100:00100000:2.0:1769074916.934748:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007296 00000100:00100000:2.0:1769074916.934825:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9104 00000100:00100000:2.0:1769074916.934836:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67064:x1855007616007296:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074916.934863:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.934892:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe775a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e290e0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.934991:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.935008:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935022:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935039:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.935045:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935052:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935118:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935126:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935134:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935140:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.935145:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935155:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935168:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.935173:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.935179:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935186:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7761 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935201:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935207:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935212:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935218:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.935221:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935227:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935234:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6f0d6dbc (ffff916052af8a00) 00010000:00010000:2.0:1769074916.935236:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.935238:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935244:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7768 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.935278:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe775a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290e0 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.935298:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.935300:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.935303:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe775a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290e0 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.935313:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e247200, rc 0) 00000100:00100000:2.0:1769074916.935403:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67064:x1855007616007296:12345-192.168.204.32@tcp:101:bash.0 Request processed in 568us (1131us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074916.935411:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9104 00000100:00100000:2.0:1769074916.945563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.950711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.950771:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.950869:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007552 00000100:00100000:2.0:1769074916.950883:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007552 00000100:00100000:2.0:1769074916.950969:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9106 00000100:00100000:2.0:1769074916.950980:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67065:x1855007616007552:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074916.951007:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.951035:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7784 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e290ee expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.951119:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.951136:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951149:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951164:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.951171:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951177:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951240:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951248:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951255:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951262:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.951266:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951279:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951302:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.951306:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.951312:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951317:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fe778b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951334:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951340:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951346:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951352:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.951354:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951361:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951368:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6f0d6dbc (ffff916052af8a00) 00010000:00010000:2.0:1769074916.951370:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.951373:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951379:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fe7792 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.951418:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7784 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290ee expref: 310 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.951428:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.951431:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.951434:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe7784 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290ee expref: 310 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.951443:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36000, rc 0) 00000100:00100000:2.0:1769074916.951524:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67065:x1855007616007552:12345-192.168.204.32@tcp:101:rm.0 Request processed in 546us (829us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074916.951569:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9106 00000100:00100000:3.0:1769074916.951871:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007680 00000100:00100000:3.0:1769074916.951879:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007680 00000100:00100000:3.0:1769074916.951940:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:3.0:1769074916.951948:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:2418:x1855007616007680:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074916.951978:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074916.951992:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7799 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e290f5 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.952191:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074916.952218:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952231:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952255:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074916.952263:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952269:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952346:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952353:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952359:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952365:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.952368:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952375:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952391:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.952394:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.952398:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952404:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe77a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952419:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952424:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952429:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952434:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074916.952437:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952441:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952448:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604ecb7300) 00010000:00010000:3.0:1769074916.952450:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074916.952453:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952457:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe77a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074916.952500:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7799 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290f5 expref: 310 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.952509:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074916.952511:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074916.952515:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fe7799 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e290f5 expref: 310 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074916.952523:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc -2) 00000100:00100000:3.0:1769074916.952679:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:2418:x1855007616007680:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 730us (1906us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074916.952689:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:1.0:1769074916.968058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.977056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.977193:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616007936 00000100:00100000:2.0:1769074916.977208:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616007936 00000100:00100000:2.0:1769074916.977331:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9108 00000100:00100000:2.0:1769074916.977344:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67066:x1855007616007936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074916.977373:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.977403:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe77c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29103 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.977635:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.977654:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977668:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977691:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.977698:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977703:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977774:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977782:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977790:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977796:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.977801:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977810:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977824:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.977827:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.977833:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977840:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe77ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977855:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977862:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977867:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977872:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.977875:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977880:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.977887:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6f0d6dbc (ffff916052af8a00) 00010000:00010000:2.0:1769074916.977889:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.977892:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.978069:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe77d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.978114:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe77c3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29103 expref: 310 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.978126:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.978129:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.978133:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe77c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29103 expref: 310 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.978144:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4a00, rc 0) 00000100:00100000:2.0:1769074916.978305:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67066:x1855007616007936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 963us (1266us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074916.978315:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9108 00000100:00100000:1.0:1769074916.981969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.982056:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616008192 00000100:00100000:2.0:1769074916.982069:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616008192 00000100:00100000:2.0:1769074916.982144:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9109 00000100:00100000:2.0:1769074916.982154:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:67066:x1855007616008192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074916.982179:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.982231:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe77d8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2910a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.982416:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.982435:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.982457:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.982475:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.982482:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.982487:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074916.982920:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9b:0x0], index 0: 0 00010000:00010000:2.0:1769074916.983106:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada400/0x557988ac98fe77ed lrc: 3/1,0 mode: --/PR res: [0x240000403:0x140:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074916.983117:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada400/0x557988ac98fe77ed lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983125:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada400/0x557988ac98fe77ed lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983159:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983165:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983171:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983177:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074916.983181:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983189:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983202:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074916.983206:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074916.983211:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983217:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe77df lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074916.983229:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d4bcd2b reply state 00000000483ab428 transno 4294968924 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983239:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074916.983245:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6f0d6dbc (ffff916052af8400) 00010000:00010000:2.0:1769074916.983248:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074916.983251:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074916.983298:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe77d8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2910a expref: 312 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.983315:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada400/0x557988ac98fe77ed lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x140:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2910a expref: 311 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074916.983322:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x140:0x0].0x0 (ffff91604e24c200) 00010000:00010000:2.0:1769074916.983324:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074916.983327:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada400, rc 0) 00000100:00100000:2.0:1769074916.983407:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67066:x1855007616008192:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1254us (1451us total) trans 4294968924 rc 0/0 00000100:00100000:2.0:1769074916.983416:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9109 00000100:00100000:1.0:1769074916.987485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074916.987692:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616008320 00000100:00100000:2.0:1769074916.987705:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616008320 00000100:00100000:2.0:1769074916.987784:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2611 00000100:00100000:2.0:1769074916.987796:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+134:2419:x1855007616008320:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074916.987819:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074916.987845:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29111 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074916.987874:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074916.987912:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074916.987915:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074916.987926:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 135 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074916.987946:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 135 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074916.987963:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adac00, rc 0) 00000100:00100000:2.0:1769074916.988035:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:2419:x1855007616008320:12345-192.168.204.32@tcp:101:cp.0 Request processed in 241us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074916.988043:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2611 00000100:00100000:3.0:1769074916.991758:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074916.992046:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616008448 00000100:00100000:1.0:1769074916.992060:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616008448 00000100:00100000:1.0:1769074916.992133:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2612 00000100:00100000:1.0:1769074916.992146:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:67066:x1855007616008448:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074916.992172:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074916.992195:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7000/0x557988ac98fe7802 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29118 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.992235:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 136 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.992244:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.992246:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074916.992252:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7000/0x557988ac98fe7802 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29118 expref: 136 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.992307:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 136 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074916.992324:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 136 pid: 25313 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074916.992341:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626607232:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074916.992486:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160e4dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074916.996750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:1.0:1769074916.997909:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052adac00/0x557988ac98fe77fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29111 expref: 137 pid: 25313 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074916.997928:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626607232:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074916.997961:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7000/0x557988ac98fe7802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29118 expref: 136 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074916.997974:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7000, rc 0) 00000100:00100000:1.0:1769074916.998015:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+136:67066:x1855007616008448:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5871us (6270us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074916.998025:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2612 00000100:00100000:3.0:1769074917.002831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.003430:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616008832 00000100:00100000:1.0:1769074917.003440:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616008832 00000100:00100000:1.0:1769074917.003510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1819 00000100:00100000:1.0:1769074917.003521:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67066:x1855007616008832:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074917.003871:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67066:x1855007616008832:12345-192.168.204.32@tcp:35:cp.0 Request processed in 352us (1055us total) trans 4294968925 rc 0/0 00000100:00100000:1.0:1769074917.003877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1819 00000100:00100000:3.0:1769074917.034470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.034668:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616008960 00000100:00100000:1.0:1769074917.034682:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616008960 00000100:00100000:1.0:1769074917.034769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9110 00000100:00100000:1.0:1769074917.034779:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67069:x1855007616008960:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074917.034805:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.034830:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe7809 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2911f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.034918:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.034936:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.034948:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.034964:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.034971:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.034977:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035038:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035044:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035050:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035057:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035064:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.035068:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035075:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035088:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.035091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.035096:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035102:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe7810 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035118:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035125:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035131:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035135:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.035138:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035143:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035148:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4ec68a1 (ffff91604f42a100) 00010000:00010000:1.0:1769074917.035150:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.035153:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035157:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7817 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.035188:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe7809 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2911f expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.035197:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.035199:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.035202:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe7809 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2911f expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.035217:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6e00, rc 0) 00000100:00100000:1.0:1769074917.035304:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67069:x1855007616008960:12345-192.168.204.32@tcp:101:bash.0 Request processed in 525us (857us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.035312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9110 00000100:00100000:3.0:1769074917.049007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.049071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.049170:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616009216 00000100:00100000:1.0:1769074917.049184:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616009216 00000100:00100000:1.0:1769074917.049250:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:1.0:1769074917.049260:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616009216:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074917.049326:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.049351:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe781e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2912d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.049427:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074917.049444:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049469:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049484:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074917.049490:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049496:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049603:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049611:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049617:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049623:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.049627:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049635:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049648:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.049651:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.049655:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049661:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7825 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049676:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049681:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049686:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049691:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.049694:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049699:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049705:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604f42a100) 00010000:00010000:1.0:1769074917.049707:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.049710:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049715:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7200/0x557988ac98fe782c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.049743:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe781e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2912d expref: 314 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.049753:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.049755:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074917.049758:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe781e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2912d expref: 314 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.049768:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6e00, rc -2) 00000100:00100000:1.0:1769074917.049842:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616009216:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 583us (771us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074917.049851:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:2.0:1769074917.050202:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616009088 00000100:00100000:2.0:1769074917.050210:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616009088 00000100:00100000:2.0:1769074917.050264:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9111 00000100:00100000:2.0:1769074917.050274:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67070:x1855007616009088:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074917.050297:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.050315:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7833 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29126 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.050360:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.050371:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050381:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050396:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.050403:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050408:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050448:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050455:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050461:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050466:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.050471:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050476:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050485:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.050488:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.050491:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050496:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe783a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050508:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050514:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050519:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050523:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.050526:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050590:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050598:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4ec68a1 (ffff91604e24c400) 00010000:00010000:2.0:1769074917.050601:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.050604:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050610:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7841 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.050635:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7833 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29126 expref: 314 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.050642:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.050644:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.050647:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7833 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29126 expref: 314 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.050656:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:2.0:1769074917.050698:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67070:x1855007616009088:12345-192.168.204.32@tcp:101:rm.0 Request processed in 427us (1705us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.050705:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9111 00000100:00100000:3.0:1769074917.056226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.057364:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616009344 00000100:00100000:1.0:1769074917.057383:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616009344 00000100:00100000:1.0:1769074917.057647:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9112 00000100:00100000:1.0:1769074917.057661:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67070:x1855007616009344:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074917.057693:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.057723:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7848 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29134 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.057805:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.057823:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.057835:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.057850:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.057857:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.057863:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058163:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058173:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058178:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058184:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058189:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.058194:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058202:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058215:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.058219:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.058226:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058232:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe784f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058314:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058321:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058326:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058331:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.058334:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058339:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058346:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4ec68a1 (ffff91604f42ad00) 00010000:00010000:1.0:1769074917.058348:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.058351:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058361:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7856 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.058401:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7848 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29134 expref: 314 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.058412:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.058414:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.058418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7848 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29134 expref: 314 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.058428:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:1.0:1769074917.060271:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67070:x1855007616009344:12345-192.168.204.32@tcp:101:rm.0 Request processed in 2596us (4776us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.060296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9112 00000100:00100000:3.0:1769074917.080718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.080894:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616009472 00000100:00100000:1.0:1769074917.080917:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616009472 00000100:00100000:1.0:1769074917.080987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9113 00000100:00100000:1.0:1769074917.080997:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67071:x1855007616009472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.081023:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.081050:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe785d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2913b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.081142:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.081159:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081177:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081192:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.081199:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081205:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081275:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081282:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081300:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081307:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081314:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.081318:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081326:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081341:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.081344:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.081352:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081359:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe7864 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081377:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081382:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081387:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081391:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.081394:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081400:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081406:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4ec68a1 (ffff91604f42ad00) 00010000:00010000:1.0:1769074917.081408:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.081411:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081416:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe786b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.081464:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe785d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2913b expref: 314 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.081475:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.081478:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.081482:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe785d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2913b expref: 314 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.081491:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:1.0:1769074917.081637:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67071:x1855007616009472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 641us (934us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.081646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9113 00000100:00100000:2.0:1769074917.086440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.094643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.101035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.101148:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616009984 00000100:00100000:1.0:1769074917.101161:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616009984 00000100:00100000:1.0:1769074917.101255:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2613 00000100:00100000:1.0:1769074917.101267:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+133:2420:x1855007616009984:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.101303:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.101332:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29150 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074917.101363:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074917.101388:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.101391:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.101402:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 134 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.101422:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 134 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.101436:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:1.0:1769074917.101522:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+134:2420:x1855007616009984:12345-192.168.204.32@tcp:101:cp.0 Request processed in 256us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.101572:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2613 00000100:00100000:2.0:1769074917.105092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.114787:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616010240 00000100:00100000:1.0:1769074917.114804:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616010240 00010000:00010000:1.0:1769074917.114883:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 135 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074917.115036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1835 00000100:00100000:1.0:1769074917.115046:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:2420:x1855007616010240:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074917.115068:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074917.115092:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 135 pid: 8405 timeout: 2006 lvb_type: 1 00010000:00010000:1.0:1769074917.115109:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 135 pid: 8405 timeout: 2006 lvb_type: 1 00010000:00010000:1.0:1769074917.115136:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78aa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29150 expref: 135 pid: 8405 timeout: 2006 lvb_type: 1 00010000:00010000:1.0:1769074917.115156:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.115158:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.115166:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5600/0x557988ac98fe78b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29157 expref: 134 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.115177:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5600/0x557988ac98fe78b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29157 expref: 134 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.115222:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5600/0x557988ac98fe78b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29157 expref: 134 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074917.115239:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626607616:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074917.115840:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044f176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074917.119342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.119598:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626607616:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074917.119635:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074917.119706:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+134:2420:x1855007616010240:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4660us (6438us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.119718:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1835 00000100:00100000:2.0:1769074917.124842:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616010496 00000100:00100000:2.0:1769074917.124863:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616010496 00000100:00100000:2.0:1769074917.125094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1820 00000100:00100000:2.0:1769074917.125106:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67071:x1855007616010496:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074917.125916:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:67071:x1855007616010496:12345-192.168.204.32@tcp:35:cp.0 Request processed in 806us (6583us total) trans 4294968927 rc 0/0 00000100:00100000:2.0:1769074917.125926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1820 00000100:00100000:3.0:1769074917.167590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.167733:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616010624 00000100:00100000:1.0:1769074917.167747:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616010624 00000100:00100000:1.0:1769074917.167817:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9116 00000100:00100000:1.0:1769074917.167827:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67074:x1855007616010624:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074917.167851:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.167875:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2915e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.167966:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.167983:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.167995:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168009:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.168016:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168023:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168087:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168094:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168101:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168108:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168114:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.168118:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168126:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168138:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.168141:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.168146:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168152:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe78bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168167:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168173:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168179:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168184:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.168187:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168192:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168198:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x22a1db4f (ffff91604f42ab00) 00010000:00010000:1.0:1769074917.168200:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.168203:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168208:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe78c6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.168237:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78b8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2915e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.168246:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.168248:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.168252:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe78b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2915e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.168260:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:1.0:1769074917.168342:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67074:x1855007616010624:12345-192.168.204.32@tcp:101:bash.0 Request processed in 515us (766us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.168350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9116 00000100:00100000:3.0:1769074917.181687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.181826:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616010880 00000100:00100000:2.0:1769074917.181841:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616010880 00000100:00100000:2.0:1769074917.181933:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:2.0:1769074917.181946:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:2420:x1855007616010880:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074917.182007:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.182036:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe78cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2916c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.182115:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074917.182133:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182147:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182164:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074917.182170:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182175:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182241:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182250:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182257:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182263:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.182268:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182276:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182299:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.182303:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.182309:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182314:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe78d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182329:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182334:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182339:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182343:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.182345:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182355:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182361:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604e24c400) 00010000:00010000:2.0:1769074917.182363:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.182365:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182371:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe78db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.182400:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe78cd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2916c expref: 318 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.182409:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.182411:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074917.182415:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe78cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2916c expref: 318 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.182424:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada200, rc -2) 00000100:00100000:2.0:1769074917.182510:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:2420:x1855007616010880:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 567us (837us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074917.182518:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:3.0:1769074917.187108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.192802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.212188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1769074917.216882:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.216977:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.216986:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.216994:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.216999:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217009:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217030:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.217034:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.217041:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217048:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7913 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217070:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217076:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217081:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217087:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.217090:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217095:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217102:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x22a1db4f (ffff916052a0c400) 00010000:00010000:2.0:1769074917.217105:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.217109:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217115:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe791a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.217175:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe790c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2917a expref: 318 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.217186:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.217189:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.217192:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe790c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2917a expref: 318 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.217201:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074917.217388:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:67076:x1855007616011136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3245us (5213us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.217398:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9119 00000100:00100000:3.0:1769074917.221554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.227232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.231371:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9121 00000100:00100000:1.0:1769074917.231384:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:67076:x1855007616011520:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.231629:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.231656:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7936 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29188 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.231822:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074917.231842:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.231856:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.231873:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074917.231881:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.231888:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074917.233034:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9c:0x0], index 0: 0 00010000:00010000:1.0:1769074917.233266:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe794b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x142:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074917.233293:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe794b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233304:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe794b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233354:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233362:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233369:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233375:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.233380:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.233387:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.234001:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.234007:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.234015:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.234024:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6000/0x557988ac98fe793d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074917.234041:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d26fff1d reply state 00000000063116d7 transno 4294968928 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.234053:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074917.234061:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x22a1db4f (ffff91604f42ab00) 00010000:00010000:1.0:1769074917.234064:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074917.234068:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074917.234120:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7936 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29188 expref: 320 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.234137:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6e00/0x557988ac98fe794b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x142:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29188 expref: 319 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.234145:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x142:0x0].0x0 (ffff91604ec78c00) 00010000:00010000:1.0:1769074917.234147:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074917.234149:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6e00, rc 0) 00000100:00100000:1.0:1769074917.234331:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67076:x1855007616011520:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2947us (7114us total) trans 4294968928 rc 0/0 00000100:00100000:1.0:1769074917.234341:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9121 00000100:00100000:3.0:1769074917.238225:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:2.0:1769074917.241486:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074917.242642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.242747:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616011776 00000100:00100000:1.0:1769074917.242760:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616011776 00000100:00100000:1.0:1769074917.242817:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2616 00000100:00100000:1.0:1769074917.242826:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+136:67076:x1855007616011776:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.242851:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.242871:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7200/0x557988ac98fe7960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29196 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.242917:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4000/0x557988ac98fe7959 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2918f expref: 137 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.242927:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.242929:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.242934:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7200/0x557988ac98fe7960 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29196 expref: 137 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.242982:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4000/0x557988ac98fe7959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2918f expref: 137 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.243000:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1b4000/0x557988ac98fe7959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2918f expref: 137 pid: 25313 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074917.243016:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626607744:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074917.243139:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045893e40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074917.246860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.247136:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626607744:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074917.247180:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7200/0x557988ac98fe7960 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29196 expref: 137 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.247209:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7200, rc 0) 00000100:00100000:1.0:1769074917.247307:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+137:67076:x1855007616011776:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4480us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.247318:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2616 00000100:00100000:3.0:1769074917.256383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.256751:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012160 00000100:00100000:2.0:1769074917.256766:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012160 00000100:00100000:2.0:1769074917.256843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1821 00000100:00100000:2.0:1769074917.256855:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67076:x1855007616012160:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074917.257431:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67076:x1855007616012160:12345-192.168.204.32@tcp:35:cp.0 Request processed in 574us (1061us total) trans 4294968929 rc 0/0 00000100:00100000:2.0:1769074917.257439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1821 00000100:00100000:1.0:1769074917.295234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.295403:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012288 00000100:00100000:2.0:1769074917.295420:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012288 00000100:00100000:2.0:1769074917.295800:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9122 00000100:00100000:2.0:1769074917.295814:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67079:x1855007616012288:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074917.295842:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.295869:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7967 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2919d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.295963:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.295981:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.295993:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296009:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.296016:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296021:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296091:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296098:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296105:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296111:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.296117:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296126:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296140:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.296144:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.296150:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296156:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe796e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296171:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296177:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296183:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296188:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.296191:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296197:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296204:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604e24c400) 00010000:00010000:2.0:1769074917.296207:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.296209:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296219:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7975 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.296254:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7967 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2919d expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.296265:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.296267:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.296271:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7967 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2919d expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.296290:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074917.296691:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67079:x1855007616012288:12345-192.168.204.32@tcp:101:bash.0 Request processed in 878us (1469us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.296700:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9122 00000100:00100000:1.0:1769074917.310170:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012416 00000100:00100000:1.0:1769074917.310186:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012416 00000100:00100000:1.0:1769074917.310339:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9123 00000100:00100000:1.0:1769074917.310352:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67080:x1855007616012416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074917.310383:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.310421:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe797c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.310528:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.310590:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310602:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310618:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.310624:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310631:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310701:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310708:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310714:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310720:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310725:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.310729:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310740:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.310756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.310761:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310766:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7983 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310783:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310788:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310793:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310797:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.310799:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310805:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310811:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604ec78200) 00010000:00010000:1.0:1769074917.310813:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.310816:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310820:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe798a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.310858:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe797c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291a4 expref: 322 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.310869:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.310871:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.310874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe797c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291a4 expref: 322 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.310884:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7e00, rc 0) 00000100:00100000:1.0:1769074917.311221:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67080:x1855007616012416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 871us (1943us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.311231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9123 00000100:00100000:3.0:1769074917.319061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.319159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.319303:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012544 00000100:00100000:1.0:1769074917.319316:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012544 00000100:00100000:1.0:1769074917.319703:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:1.0:1769074917.319719:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2418:x1855007616012544:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074917.319767:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.319795:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7991 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291ab expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.319868:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074917.319885:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.319910:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.319931:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074917.319938:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.319944:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320016:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320024:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320032:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320038:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.320043:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320051:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320066:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.320069:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.320075:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320081:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7998 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320100:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320106:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320112:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320117:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.320119:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320124:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320131:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604ec78800) 00010000:00010000:1.0:1769074917.320133:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.320136:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320142:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe799f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074917.320176:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7991 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ab expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.320186:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.320188:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074917.320192:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7991 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ab expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.320202:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc -2) 00000100:00100000:1.0:1769074917.320301:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2418:x1855007616012544:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 585us (1254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074917.320310:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:3.0:1769074917.335727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.335936:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012800 00000100:00100000:2.0:1769074917.335952:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012800 00000100:00100000:2.0:1769074917.336032:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9125 00000100:00100000:2.0:1769074917.336043:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67081:x1855007616012800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.336069:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.336096:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe79bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291b9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.336184:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.336202:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336220:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336237:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.336244:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336251:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336336:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336343:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336349:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336355:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.336360:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336368:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336384:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.336388:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.336394:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336400:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe79c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336416:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336422:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336428:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336432:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.336435:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336440:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336447:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604e24c400) 00010000:00010000:2.0:1769074917.336450:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.336452:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336458:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe79c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.336498:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe79bb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291b9 expref: 322 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.336510:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.336512:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.336515:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe79bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291b9 expref: 322 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.336579:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074917.336666:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67081:x1855007616012800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 625us (955us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.336675:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9125 00000100:00100000:1.0:1769074917.340679:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616012928 00000100:00100000:1.0:1769074917.340693:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616012928 00000100:00100000:1.0:1769074917.340756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9126 00000100:00100000:1.0:1769074917.340765:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67081:x1855007616012928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.340790:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.340813:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe79d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.340899:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.340918:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.340931:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.340946:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.340953:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.340958:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341030:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341036:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341043:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341049:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341055:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.341059:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341067:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341080:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.341084:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.341090:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341096:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe79d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341113:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341118:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341124:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341129:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.341132:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341140:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341146:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff91604ec78800) 00010000:00010000:1.0:1769074917.341149:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.341151:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341156:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6200/0x557988ac98fe79de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.341192:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe79d0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291c0 expref: 322 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.341202:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.341205:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.341208:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe79d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291c0 expref: 322 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.341217:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074917.341307:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67081:x1855007616012928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 541us (832us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074917.341316:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9126 00000100:00100000:3.0:1769074917.345806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.358308:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616013312 00000100:00100000:1.0:1769074917.358321:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616013312 00000100:00100000:1.0:1769074917.358500:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2617 00000100:00100000:1.0:1769074917.358512:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+134:2419:x1855007616013312:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.358560:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.358589:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291ce expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074917.358622:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074917.358660:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.358663:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.358674:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ce expref: 135 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.358695:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ce expref: 135 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.358710:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074917.358789:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:2419:x1855007616013312:12345-192.168.204.32@tcp:101:cp.0 Request processed in 280us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.358797:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2617 00000100:00100000:1.0:1769074917.363193:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616013440 00000100:00100000:1.0:1769074917.363207:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616013440 00000100:00100000:1.0:1769074917.363291:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2618 00000100:00100000:1.0:1769074917.363304:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:67081:x1855007616013440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.363330:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.363353:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291d5 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.363402:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ce expref: 136 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.363411:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.363414:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.363419:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7a0f lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291d5 expref: 136 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.363471:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ce expref: 136 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.363489:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7a08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ce expref: 136 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074917.363507:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626608000:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074917.364034:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045893e40 going to sleep for 11 seconds 00000100:00100000:1.0:1769074917.368327:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626608000:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074917.368375:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a6200/0x557988ac98fe7a0f lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291d5 expref: 136 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.368411:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6200, rc 0) 00000100:00100000:1.0:1769074917.368503:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+136:67081:x1855007616013440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5201us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.368513:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2618 00000100:00100000:3.0:1769074917.371169:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.377402:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626608128:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074917.377453:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074917.377560:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+135:2419:x1855007616013568:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6057us (6377us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.377573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1837 00000100:00100000:3.0:1769074917.383028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.383261:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616013824 00000100:00100000:2.0:1769074917.383276:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616013824 00000100:00100000:2.0:1769074917.383368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1822 00000100:00100000:2.0:1769074917.383380:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67081:x1855007616013824:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074917.383861:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67081:x1855007616013824:12345-192.168.204.32@tcp:35:cp.0 Request processed in 481us (846us total) trans 4294968931 rc 0/0 00000100:00100000:2.0:1769074917.383871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1822 00000100:00100000:3.0:1769074917.457141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.475275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.475357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.476478:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616014208 00000100:00100000:3.0:1769074917.476507:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616014208 00000100:00100000:2.0:1769074917.476861:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:2.0:1769074917.476878:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2418:x1855007616014208:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074917.476945:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.476972:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a2b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291ea expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.477049:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074917.477066:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477079:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477095:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074917.477103:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477109:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477174:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477181:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477188:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477193:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.477198:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477205:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477218:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.477221:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.477226:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477231:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477246:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477252:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477258:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477264:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.477266:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477272:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477289:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604e24c400) 00010000:00010000:2.0:1769074917.477292:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.477294:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477308:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a39 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074917.477342:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a2b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ea expref: 326 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.477352:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.477354:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074917.477358:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ea expref: 326 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.477367:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc -2) 00000100:00100000:2.0:1769074917.477465:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2418:x1855007616014208:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 592us (2106us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074917.477474:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:1.0:1769074917.492071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.513123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.514294:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9131 00000100:00100000:2.0:1769074917.514315:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67087:x1855007616014464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.514344:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.514375:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a6a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291f8 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.514479:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.514843:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.514861:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.514882:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.514963:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.514973:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515045:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515053:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515060:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515072:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.515077:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515085:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515099:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.515103:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.515109:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515115:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7a71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515133:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515138:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515143:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515147:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.515150:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515155:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515161:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3de31cd (ffff91604e24c400) 00010000:00010000:2.0:1769074917.515163:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.515166:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515171:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7a78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.515214:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a6a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291f8 expref: 326 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.515224:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.515227:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.515230:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7a6a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291f8 expref: 326 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.515239:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074917.515412:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67087:x1855007616014464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1099us (2303us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.515422:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9131 00000100:00100000:1.0:1769074917.520793:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.521009:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616014592 00000100:00100000:2.0:1769074917.521025:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616014592 00000100:00100000:2.0:1769074917.521143:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9132 00000100:00100000:2.0:1769074917.521155:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67087:x1855007616014592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.521184:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.521213:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7a7f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e291ff expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.521322:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.521339:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521353:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521369:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.521375:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521380:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521809:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521817:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521824:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521830:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.521834:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521841:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521854:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.521857:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.521863:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521869:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7a86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521885:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521970:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521975:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521980:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.521983:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521988:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.521995:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3de31cd (ffff91604e24ce00) 00010000:00010000:2.0:1769074917.521998:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.522001:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.522006:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7a8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.522047:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7a7f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ff expref: 326 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.522056:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.522059:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.522063:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7a7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e291ff expref: 326 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.522076:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc 0) 00000100:00100000:2.0:1769074917.522163:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67087:x1855007616014592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1010us (1385us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.522172:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9132 00000100:00100000:1.0:1769074917.528936:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616014848 00000100:00100000:1.0:1769074917.528952:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616014848 00000100:00100000:1.0:1769074917.529026:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9133 00000100:00100000:1.0:1769074917.529037:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67087:x1855007616014848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.529065:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.529095:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7a94 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29206 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.529259:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.529289:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.529312:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.529332:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3de31cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.529339:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.529345:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074917.529787:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9d:0x0], index 0: 0 00010000:00010000:1.0:1769074917.529980:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe7aa9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x144:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.529997:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe7aa9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530005:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe7aa9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530046:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530053:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530058:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530064:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530071:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.530076:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530084:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530097:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.530100:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.530105:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7a9b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074917.530127:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e3368d4 reply state 000000009b37e719 transno 4294968932 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530141:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.530147:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3de31cd (ffff91604ec78a00) 00010000:00010000:1.0:1769074917.530150:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074917.530153:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074917.530189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7a94 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29206 expref: 328 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.530207:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6a00/0x557988ac98fe7aa9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x144:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29206 expref: 327 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.530215:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x144:0x0].0x0 (ffff91604ec78400) 00010000:00010000:1.0:1769074917.530217:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074917.530220:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6a00, rc 0) 00000100:00100000:1.0:1769074917.530322:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67087:x1855007616014848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1285us (1584us total) trans 4294968932 rc 0/0 00000100:00100000:1.0:1769074917.530332:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9133 00000100:00100000:1.0:1769074917.536033:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616014976 00000100:00100000:1.0:1769074917.536047:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616014976 00000100:00100000:1.0:1769074917.536124:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2619 00000100:00100000:1.0:1769074917.536137:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+136:2419:x1855007616014976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.536160:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.536187:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2920d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074917.536216:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074917.536246:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.536248:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.536258:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 137 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.536289:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 137 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.536306:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074917.536747:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+137:2419:x1855007616014976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 612us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.536756:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2619 00000100:00100000:1.0:1769074917.542247:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616015104 00000100:00100000:1.0:1769074917.542261:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616015104 00000100:00100000:1.0:1769074917.542331:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2620 00000100:00100000:1.0:1769074917.542343:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+137:67087:x1855007616015104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.542365:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.542389:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6000/0x557988ac98fe7abe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29214 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.542427:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 138 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.542436:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.542438:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.542442:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6000/0x557988ac98fe7abe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29214 expref: 138 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.542490:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 138 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074917.542517:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 138 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074917.542557:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626608256:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074917.542905:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160458936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074917.548960:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:1.0:1769074917.553475:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7ab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2920d expref: 139 pid: 8405 timeout: 2006 lvb_type: 1 00000100:00100000:1.0:1769074917.553503:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049d20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626608256:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074917.553559:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6000/0x557988ac98fe7abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29214 expref: 138 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.553576:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6000, rc 0) 00000100:00100000:1.0:1769074917.554095:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:67087:x1855007616015104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11750us (12082us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074917.554107:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2620 00000100:00100000:1.0:1769074917.556855:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626608384:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074917.556904:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074917.560191:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616015488 00000100:00100000:1.0:1769074917.560207:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616015488 00000100:00100000:1.0:1769074917.600360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.600630:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616015616 00000100:00100000:2.0:1769074917.600656:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616015616 00000100:00100000:2.0:1769074917.600734:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9134 00000100:00100000:2.0:1769074917.600747:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67090:x1855007616015616:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074917.600776:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.600805:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7ac5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2921b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.601112:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.601134:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601148:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601168:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.601174:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601180:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601252:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601260:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601266:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601273:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.601287:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601295:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601310:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.601314:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.601320:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601326:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7acc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601342:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601348:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601353:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601358:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.601362:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601367:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601375:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fa77733 (ffff91604e24ce00) 00010000:00010000:2.0:1769074917.601377:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.601380:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601386:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ad3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.601425:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7ac5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2921b expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.601435:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.601448:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.601452:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7ac5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2921b expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.601461:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb200, rc 0) 00000100:00100000:2.0:1769074917.601732:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67090:x1855007616015616:12345-192.168.204.32@tcp:101:bash.0 Request processed in 987us (1387us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.601740:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9134 00000100:00100000:3.0:1769074917.619231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.621366:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.622112:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616015872 00000100:00100000:3.0:1769074917.622128:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616015872 00000100:00100000:3.0:1769074917.622222:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:3.0:1769074917.622236:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:2417:x1855007616015872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074917.622302:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074917.622327:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ada lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29229 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.622405:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074917.622422:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.622435:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624387:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074917.624412:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624426:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624488:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624495:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624502:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624507:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.624511:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.624518:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00000100:00100000:2.0:1769074917.624739:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616015744 00000100:00100000:2.0:1769074917.624756:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616015744 00000100:00100000:2.0:1769074917.624915:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9135 00000100:00100000:2.0:1769074917.624929:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:67091:x1855007616015744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074917.624959:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.624981:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7aef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29222 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.625056:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.628628:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.628755:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.628796:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.628805:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.628812:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629340:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629351:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629359:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629366:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.629371:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629385:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629402:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.629405:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.629412:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629419:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7af6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629823:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629834:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629841:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629846:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.629849:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629856:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629876:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fa77733 (ffff91604e24ce00) 00010000:00010000:2.0:1769074917.629879:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.629883:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629896:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7afd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.629956:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7aef lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29222 expref: 332 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.629967:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.629970:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.629973:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7aef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29222 expref: 332 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.629983:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb200, rc 0) 00000100:00100000:2.0:1769074917.630088:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:67091:x1855007616015744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 5161us (10868us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.630100:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9135 00010000:00010000:3.0:1769074917.634334:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.634344:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.634357:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634369:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe7ae1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634394:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00000100:00100000:2.0:1769074917.634568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1769074917.634774:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634783:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634793:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.634802:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634821:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634838:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604ecb7300) 00010000:00010000:3.0:1769074917.634841:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.634846:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634855:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7ae8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.634905:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ada lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29229 expref: 331 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.634919:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.634922:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074917.634926:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ada lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29229 expref: 332 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.634937:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a800, rc -2) 00000100:00100000:3.0:1769074917.635026:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:2417:x1855007616015872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 12791us (13669us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074917.635044:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:2.0:1769074917.664685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.671970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.685185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.694168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.699326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.704364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.704585:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616016896 00000100:00100000:1.0:1769074917.704599:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616016896 00010000:00010000:1.0:1769074917.704673:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7b66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2924c expref: 138 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:1.0:1769074917.704727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1839 00000100:00100000:1.0:1769074917.704737:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2419:x1855007616016896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074917.704757:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074917.704786:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7b66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2924c expref: 138 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074917.704802:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7b66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2924c expref: 138 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074917.704835:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.704837:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.704846:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5000/0x557988ac98fe7b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29253 expref: 138 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.704856:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5000/0x557988ac98fe7b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29253 expref: 138 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.704912:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1b5000/0x557988ac98fe7b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29253 expref: 138 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074917.704931:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626608640:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074917.705043:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160458936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074917.713499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.754126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.766131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.770164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.770368:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616017536 00000100:00100000:3.0:1769074917.770384:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616017536 00000100:00100000:3.0:1769074917.770466:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:3.0:1769074917.770479:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2420:x1855007616017536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074917.770563:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074917.770588:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe7b9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29268 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.770674:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074917.770694:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770709:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770726:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074917.770733:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770740:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770808:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770816:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770823:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770830:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.770835:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770843:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770857:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.770860:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.770868:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.770874:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe7ba5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771239:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771248:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771253:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771258:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.771261:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771267:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771292:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604ecb7300) 00010000:00010000:3.0:1769074917.771295:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.771298:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771304:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe7bac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074917.771341:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe7b9e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29268 expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.771353:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.771355:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074917.771359:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe7b9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29268 expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.771368:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a600, rc -2) 00000100:00100000:3.0:1769074917.771689:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2420:x1855007616017536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1209us (1535us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074917.771700:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:2.0:1769074917.780148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.796866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.799270:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67097:x1855007616017792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2037us (2416us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.799290:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9143 00000100:00100000:1.0:1769074917.807190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.807313:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616017920 00000100:00100000:2.0:1769074917.807329:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616017920 00000100:00100000:2.0:1769074917.807408:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9144 00000100:00100000:2.0:1769074917.807419:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67097:x1855007616017920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.807458:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.807489:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7bdd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2927d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.807623:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.807989:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808006:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808026:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.808033:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808040:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808107:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808115:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808122:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808128:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.808133:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808142:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808154:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.808157:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.808163:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808169:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7be4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808183:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808190:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808195:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808200:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.808203:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808208:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808215:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaf4cee59 (ffff91604e24ce00) 00010000:00010000:2.0:1769074917.808218:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.808220:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808226:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adae00/0x557988ac98fe7beb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.808269:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7bdd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2927d expref: 334 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.808293:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.808295:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.808299:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7bdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2927d expref: 334 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.808310:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adba00, rc 0) 00000100:00100000:2.0:1769074917.808399:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67097:x1855007616017920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 979us (1223us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.808408:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9144 00000100:00100000:1.0:1769074917.813295:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.813395:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616018176 00000100:00100000:2.0:1769074917.813412:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616018176 00000100:00100000:2.0:1769074917.813516:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9145 00000100:00100000:2.0:1769074917.813570:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67097:x1855007616018176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.813600:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.813630:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7bf2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29284 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.813796:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.813816:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.813828:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.813851:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.813858:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.813865:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074917.815058:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9e:0x0], index 0: 0 00010000:00010000:2.0:1769074917.815287:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7c07 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x146:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.815305:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7c07 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815314:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7c07 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815354:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815361:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815368:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815374:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.815378:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815387:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815401:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.815404:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.815410:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815416:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7bf9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074917.815430:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000036f30a03 reply state 000000001e152c07 transno 4294968936 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815456:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.815462:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaf4cee59 (ffff91604e24c400) 00010000:00010000:2.0:1769074917.815464:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074917.815468:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074917.816229:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7bf2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29284 expref: 336 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.816253:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adba00/0x557988ac98fe7c07 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x146:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29284 expref: 335 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.816260:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x146:0x0].0x0 (ffff91604e24ce00) 00010000:00010000:2.0:1769074917.816263:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074917.816266:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adba00, rc 0) 00000100:00100000:2.0:1769074917.816381:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67097:x1855007616018176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2854us (3112us total) trans 4294968936 rc 0/0 00000100:00100000:2.0:1769074917.816392:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9145 00000100:00100000:3.0:1769074917.819859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.825334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.826007:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616018432 00000100:00100000:2.0:1769074917.826023:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616018432 00000100:00100000:2.0:1769074917.826146:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2624 00000100:00100000:2.0:1769074917.826157:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:67097:x1855007616018432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.826183:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.826207:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adae00/0x557988ac98fe7c1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29292 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.826247:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b4bc00/0x557988ac98fe7c15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2928b expref: 139 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074917.826256:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074917.826258:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074917.826262:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adae00/0x557988ac98fe7c1c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29292 expref: 139 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.826318:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052b4bc00/0x557988ac98fe7c15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2928b expref: 139 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074917.826334:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052b4bc00/0x557988ac98fe7c15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2928b expref: 139 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:2.0:1769074917.826351:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626608768:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074917.826494:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074917.829881:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626608768:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074917.829947:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adae00/0x557988ac98fe7c1c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29292 expref: 139 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.829980:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adae00, rc 0) 00000100:00100000:2.0:1769074917.830059:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:67097:x1855007616018432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3902us (4740us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074917.830070:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2624 00000100:00100000:3.0:1769074917.833049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.841606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.874960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.875248:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616018944 00000100:00100000:2.0:1769074917.875263:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616018944 00000100:00100000:2.0:1769074917.875366:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9146 00000100:00100000:2.0:1769074917.875378:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67100:x1855007616018944:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074917.875406:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.875442:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7c23 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29299 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.875589:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.875607:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.875620:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.875633:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.875972:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.875983:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876367:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876377:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876385:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876392:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.876397:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876405:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876421:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.876425:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.876441:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876447:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7c2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876462:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876468:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876474:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876478:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074917.876481:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876487:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876508:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87382141 (ffff91604e24cf00) 00010000:00010000:3.0:1769074917.876510:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.876513:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876518:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7c31 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074917.876623:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7c23 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29299 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.876634:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074917.876637:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074917.876803:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7c23 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29299 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074917.876816:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb200, rc 0) 00000100:00100000:3.0:1769074917.877052:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67100:x1855007616018944:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1673us (2102us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074917.877063:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9146 00000100:00100000:1.0:1769074917.886244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.886328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.889360:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616019072 00000100:00100000:3.0:1769074917.889378:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616019072 00000100:00100000:2.0:1769074917.890157:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9147 00000100:00100000:2.0:1769074917.890172:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67101:x1855007616019072:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074917.890199:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.890225:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292a0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.890324:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.890343:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890358:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890377:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074917.890382:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890388:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890466:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890474:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890480:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890506:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.890511:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890519:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890567:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.890571:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.890577:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890583:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890598:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890604:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890609:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890613:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.890616:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890620:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890626:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87382141 (ffff91604e24c000) 00010000:00010000:2.0:1769074917.890629:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.890632:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890637:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074917.890935:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c4d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292a0 expref: 338 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.890946:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.890949:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.890952:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292a0 expref: 338 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.890962:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074917.891054:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67101:x1855007616019072:12345-192.168.204.32@tcp:101:rm.0 Request processed in 885us (4822us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.891061:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9147 00000100:00100000:1.0:1769074917.895019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.916579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.916914:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616019456 00000100:00100000:2.0:1769074917.916930:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616019456 00000100:00100000:2.0:1769074917.917004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9149 00000100:00100000:2.0:1769074917.917015:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67102:x1855007616019456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.917045:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.917074:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c77 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.917163:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074917.917180:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917193:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917208:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074917.917215:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917220:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917298:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917305:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917312:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917319:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917325:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.917329:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917338:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917352:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.917355:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.917361:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917366:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7c7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917380:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917386:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917390:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917394:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074917.917396:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917401:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917406:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87382141 (ffff91604e24c000) 00010000:00010000:2.0:1769074917.917408:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.917410:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917415:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7c85 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074917.917457:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c77 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292b5 expref: 338 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.917466:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074917.917468:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074917.917472:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7c77 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292b5 expref: 338 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074917.917481:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074917.917608:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67102:x1855007616019456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 594us (1094us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074917.917616:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9149 00000100:00100000:2.0:1769074917.921770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.927241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.927392:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616019840 00000100:00100000:1.0:1769074917.927407:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616019840 00000100:00100000:1.0:1769074917.927496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9151 00000100:00100000:1.0:1769074917.927507:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67102:x1855007616019840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074917.927743:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074917.927772:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ca1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.928091:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.928110:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.928123:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.928141:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x87382141 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.928147:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.928154:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074917.929159:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x9f:0x0], index 1: 0 00010000:00010000:1.0:1769074917.929373:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7cb6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x147:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074917.929388:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929398:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929786:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929795:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929802:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929809:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929815:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074917.929819:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929828:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929841:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074917.929845:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074917.929850:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929857:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ca8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074917.929872:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069b4ec2d reply state 0000000034fe3b58 transno 4294968938 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929892:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074917.929898:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87382141 (ffff91604ec78000) 00010000:00010000:1.0:1769074917.929900:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074917.929903:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074917.929944:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ca1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292c3 expref: 340 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.929959:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6400/0x557988ac98fe7cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292c3 expref: 339 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.929967:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x147:0x0].0x0 (ffff91604ec78300) 00010000:00010000:1.0:1769074917.929969:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074917.929972:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6400, rc 0) 00000100:00100000:1.0:1769074917.930053:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67102:x1855007616019840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2548us (2826us total) trans 4294968938 rc 0/0 00000100:00100000:1.0:1769074917.930061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9151 00000100:00100000:1.0:1769074917.934091:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.934172:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616019968 00000100:00100000:2.0:1769074917.934185:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616019968 00000100:00100000:2.0:1769074917.934254:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2625 00000100:00100000:2.0:1769074917.934266:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+136:2420:x1855007616019968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074917.934301:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074917.934329:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292ca expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074917.934359:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074917.934385:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074917.934388:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074917.934399:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 137 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074917.934420:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 137 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074917.934445:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adac00, rc 0) 00000100:00100000:2.0:1769074917.934519:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+137:2420:x1855007616019968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 255us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074917.934583:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2625 00000100:00100000:2.0:1769074917.939865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074917.944111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074917.947060:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616020224 00000100:00100000:1.0:1769074917.947079:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616020224 00010000:00010000:1.0:1769074917.947169:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 138 pid: 25313 timeout: 2007 lvb_type: 1 00000100:00100000:1.0:1769074917.947210:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1841 00000100:00100000:1.0:1769074917.947221:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2419:x1855007616020224:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074917.947241:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074917.947269:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 138 pid: 25313 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074917.947297:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 138 pid: 25313 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074917.947327:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052adac00/0x557988ac98fe7cc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292ca expref: 138 pid: 25313 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074917.947346:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.947348:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074917.947357:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b4aa00/0x557988ac98fe7ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292d1 expref: 137 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.947369:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4aa00/0x557988ac98fe7ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292d1 expref: 137 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074917.947419:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b4aa00/0x557988ac98fe7ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292d1 expref: 137 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074917.947868:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626609152:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074917.948016:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160458930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074917.952123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074917.952213:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616020480 00000100:00100000:2.0:1769074917.952226:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616020480 00000100:00100000:2.0:1769074917.952313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1826 00000100:00100000:2.0:1769074917.952324:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67102:x1855007616020480:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074917.952960:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67102:x1855007616020480:12345-192.168.204.32@tcp:35:cp.0 Request processed in 634us (849us total) trans 4294968939 rc 0/0 00000100:00100000:2.0:1769074917.952970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1826 00000100:00100000:2.0:1769074918.016760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.016891:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616020608 00000100:00100000:1.0:1769074918.016906:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616020608 00000100:00100000:1.0:1769074918.016991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9152 00000100:00100000:1.0:1769074918.017003:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67106:x1855007616020608:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074918.017032:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.017061:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cd2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.017156:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.017176:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017190:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017208:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.017216:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017224:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017305:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017313:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017321:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017328:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017335:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.017340:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017349:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017366:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.017370:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.017376:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017383:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7cd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017403:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017409:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017415:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017420:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.017423:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017891:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017903:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604ec78500) 00010000:00010000:1.0:1769074918.017906:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.017910:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017917:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.017965:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cd2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292d8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.017977:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.017980:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.017984:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292d8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.017996:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8c200, rc 0) 00000100:00100000:1.0:1769074918.018089:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67106:x1855007616020608:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1088us (1346us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.018099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9152 00000100:00100000:3.0:1769074918.029960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.030069:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616020736 00000100:00100000:1.0:1769074918.030082:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616020736 00000100:00100000:1.0:1769074918.030161:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9153 00000100:00100000:1.0:1769074918.030172:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67107:x1855007616020736:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074918.030204:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.030230:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e292df expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.030333:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.030352:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030365:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030381:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.030388:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030394:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030474:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030482:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030488:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030494:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030500:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.030505:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030514:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030527:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.030568:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.030575:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030581:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7cee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030597:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030602:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030608:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030613:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.030615:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030621:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030628:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604ec78500) 00010000:00010000:1.0:1769074918.030630:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.030633:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030639:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7cf5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.030671:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292df expref: 342 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.030683:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.030685:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.030689:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7ce7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e292df expref: 342 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.030698:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074918.030764:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67107:x1855007616020736:12345-192.168.204.32@tcp:101:rm.0 Request processed in 594us (819us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.030772:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9153 00000100:00100000:3.0:1769074918.037339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.043075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:0.0:1769074918.043760:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d11 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2931e expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.043770:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.043773:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.043776:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2931e expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.043785:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a600, rc 0) 00000100:00100000:0.0:1769074918.043859:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67107:x1855007616020992:12345-192.168.204.32@tcp:101:rm.0 Request processed in 587us (800us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.043868:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9154 00000100:00100000:3.0:1769074918.063483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.063684:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021248 00000100:00100000:0.0:1769074918.063700:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021248 00000100:00100000:0.0:1769074918.063778:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:0.0:1769074918.063789:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:2417:x1855007616021248:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074918.063864:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.063901:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7d26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2932c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.063978:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.063996:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064009:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064027:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.064040:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064046:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064114:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064121:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064128:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064135:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.064140:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064149:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064163:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.064167:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.064172:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064179:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064196:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064204:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064211:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064215:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.064219:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064225:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064232:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.064235:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.064237:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064244:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d34 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.064289:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7d26 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2932c expref: 342 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.064300:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.064302:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074918.064305:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7d26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2932c expref: 342 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.064316:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1b5400, rc -2) 00000100:00100000:0.0:1769074918.064406:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:2417:x1855007616021248:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 618us (939us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074918.064415:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:0.0:1769074918.064664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.064838:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021120 00000100:00100000:1.0:1769074918.064844:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021120 00000100:00100000:1.0:1769074918.064900:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9155 00000100:00100000:1.0:1769074918.064909:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67110:x1855007616021120:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.064922:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.064938:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7d3b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29325 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.064983:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.064995:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065003:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065022:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074918.065030:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065036:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065072:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065077:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065083:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065089:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065095:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.065099:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065104:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065114:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.065116:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.065119:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065125:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7d42 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065137:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065142:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065147:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065152:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.065155:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065160:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604ec78500) 00010000:00010000:1.0:1769074918.065169:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.065173:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065178:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d49 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074918.065203:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7d3b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29325 expref: 342 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.065211:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.065213:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.065217:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7d3b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29325 expref: 342 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.065230:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8c200, rc 0) 00000100:00100000:1.0:1769074918.065285:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67110:x1855007616021120:12345-192.168.204.32@tcp:101:cp.0 Request processed in 378us (621us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.065292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9155 00000100:00100000:1.0:1769074918.071600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.071773:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021376 00000100:00100000:0.0:1769074918.071787:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021376 00000100:00100000:0.0:1769074918.071908:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9156 00000100:00100000:0.0:1769074918.071921:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67110:x1855007616021376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.071951:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.071979:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29364 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.072075:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074918.072094:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072109:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072126:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074918.072132:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072138:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072204:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072211:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072218:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072225:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.072230:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072238:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072253:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.072256:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.072263:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072279:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7d57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072296:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072301:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072306:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072310:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.072313:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072318:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072325:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.072327:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.072331:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072335:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7d5e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074918.072373:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d50 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29364 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.072383:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.072386:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.072389:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7d50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29364 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.072398:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a200, rc 0) 00000100:00100000:0.0:1769074918.073358:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67110:x1855007616021376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1430us (1765us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.073373:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9156 00000100:00100000:1.0:1769074918.078405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.078818:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021632 00000100:00100000:2.0:1769074918.078834:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021632 00000100:00100000:2.0:1769074918.079028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9157 00000100:00100000:2.0:1769074918.079042:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67110:x1855007616021632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.079070:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.079097:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7d65 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2936b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.079279:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.079300:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.079316:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.079338:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x85af2885 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.079345:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.079351:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074918.079923:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9f:0x0], index 0: 0 00010000:00010000:2.0:1769074918.080113:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7d7a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x148:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.080125:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7d7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080133:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7d7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080171:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080177:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080183:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080189:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080194:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.080198:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080206:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.080221:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.080226:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080232:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7d6c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074918.080247:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca4c5a6a reply state 000000005fea8c6f transno 4294968940 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080257:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.080263:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604e24c000) 00010000:00010000:2.0:1769074918.080266:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074918.080279:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074918.080320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada200/0x557988ac98fe7d65 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2936b expref: 344 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.080337:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada600/0x557988ac98fe7d7a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x148:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2936b expref: 343 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.080345:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x148:0x0].0x0 (ffff91604e24c900) 00010000:00010000:2.0:1769074918.080347:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074918.080351:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada600, rc 0) 00000100:00100000:2.0:1769074918.081368:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67110:x1855007616021632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2319us (2969us total) trans 4294968940 rc 0/0 00000100:00100000:2.0:1769074918.081384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9157 00000100:00100000:2.0:1769074918.084782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.084894:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021760 00000100:00100000:1.0:1769074918.084907:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021760 00000100:00100000:1.0:1769074918.084977:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2627 00000100:00100000:1.0:1769074918.084989:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2420:x1855007616021760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.085011:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.085048:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29372 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074918.085077:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074918.085102:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.085105:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.085114:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 139 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.085133:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 139 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.085147:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074918.085225:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616021760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 238us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.085236:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2627 00000100:00100000:1.0:1769074918.090184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.090286:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616021888 00000100:00100000:2.0:1769074918.090301:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616021888 00000100:00100000:2.0:1769074918.090375:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2628 00000100:00100000:2.0:1769074918.090387:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:67110:x1855007616021888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.090411:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.090444:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29379 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.090484:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.090493:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.090496:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.090500:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29379 expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.090603:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.090620:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 140 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:2.0:1769074918.090635:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626609280:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074918.090763:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074918.093965:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.094082:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022016 00000100:00100000:0.0:1769074918.094095:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022016 00010000:00010000:0.0:1769074918.094165:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:0.0:1769074918.094218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1842 00000100:00100000:0.0:1769074918.094228:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2420:x1855007616022016:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074918.094245:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074918.094280:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:0.0:1769074918.094302:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:0.0:1769074918.094336:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.094339:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.094348:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29379 expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.094359:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29379 expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.094411:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29379 expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074918.094427:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626609408:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074918.094590:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1180 going to sleep for 11 seconds 00010000:00010000:2.0:1769074918.095452:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe7d88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29372 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:2.0:1769074918.095473:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626609280:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074918.095517:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052ada200/0x557988ac98fe7d8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29379 expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.095576:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada200, rc 0) 00000100:00100000:2.0:1769074918.095635:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:67110:x1855007616021888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5249us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074918.095644:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2628 00000100:00100000:0.0:1769074918.099242:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626609408:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074918.099308:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074918.099380:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616022016:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5151us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.099392:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1842 00000100:00100000:3.0:1769074918.102632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.102784:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022272 00000100:00100000:2.0:1769074918.102797:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022272 00000100:00100000:2.0:1769074918.102862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1827 00000100:00100000:2.0:1769074918.102871:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67110:x1855007616022272:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074918.103232:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67110:x1855007616022272:12345-192.168.204.32@tcp:35:cp.0 Request processed in 361us (611us total) trans 4294968941 rc 0/0 00000100:00100000:2.0:1769074918.103240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1827 00000100:00100000:3.0:1769074918.131889:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.132144:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022400 00000100:00100000:1.0:1769074918.132159:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022400 00000100:00100000:1.0:1769074918.132238:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:1.0:1769074918.132251:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2420:x1855007616022400:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074918.132344:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.132372:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7d96 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29380 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.132452:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074918.132471:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132485:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132503:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074918.132510:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132516:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132629:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132636:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132644:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132650:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.132654:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132662:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132675:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.132678:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.132685:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132691:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7d9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132704:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132709:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132713:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132718:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.132720:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132725:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132735:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff91604ec78600) 00010000:00010000:1.0:1769074918.132737:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.132740:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132745:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7da4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074918.132779:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7d96 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29380 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.132790:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.132792:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074918.132795:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7d96 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29380 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.132804:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc -2) 00000100:00100000:1.0:1769074918.133069:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2420:x1855007616022400:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 819us (1204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074918.133079:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:3.0:1769074918.140788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.140941:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022528 00000100:00100000:2.0:1769074918.140958:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022528 00000100:00100000:2.0:1769074918.141046:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9158 00000100:00100000:2.0:1769074918.141059:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67117:x1855007616022528:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074918.141089:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.141118:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e293b8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.141216:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.141235:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141249:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141277:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.141286:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141292:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141364:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141373:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141380:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141387:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141393:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.141398:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141411:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141425:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.141428:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.141434:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141440:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7db2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141456:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141463:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141469:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141473:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.141476:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141482:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141489:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604e24c700) 00010000:00010000:2.0:1769074918.141491:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.141494:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141499:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7db9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.141593:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293b8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.141603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.141605:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.141610:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293b8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.141619:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:2.0:1769074918.141701:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67117:x1855007616022528:12345-192.168.204.32@tcp:101:bash.0 Request processed in 643us (927us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.141709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9158 00000100:00100000:3.0:1769074918.159743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.159860:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.160147:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022784 00000100:00100000:2.0:1769074918.160163:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022784 00000100:00100000:2.0:1769074918.160237:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:2.0:1769074918.160249:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616022784:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.160334:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.160360:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dc0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e293c6 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.160441:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.160460:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160474:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160507:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.160515:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160521:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160635:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160643:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160650:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160657:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.160661:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160669:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160683:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.160686:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.160693:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160699:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7dc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160716:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160722:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160728:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160734:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.160736:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160743:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160750:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604e24c700) 00010000:00010000:2.0:1769074918.160753:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.160756:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160762:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7dce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.160796:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dc0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293c6 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.160807:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.160809:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.160813:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7dc0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293c6 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.160822:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc -2) 00000100:00100000:2.0:1769074918.160919:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616022784:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 672us (1057us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.160928:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:0.0:1769074918.165848:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022656 00000100:00100000:0.0:1769074918.165870:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022656 00000100:00100000:1.0:1769074918.166140:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9159 00000100:00100000:1.0:1769074918.166153:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67118:x1855007616022656:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074918.166180:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.166206:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7dd5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e293bf expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.166306:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.166330:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166344:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166365:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.166372:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166378:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166458:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166466:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166473:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166479:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.166484:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166506:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166521:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.166524:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.166554:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166561:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ddc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166576:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166583:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166588:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166593:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.166596:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166602:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166609:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604ec78600) 00010000:00010000:1.0:1769074918.166612:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.166614:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166621:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7de3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.166661:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7dd5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293bf expref: 346 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.166672:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.166675:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.166679:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7dd5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293bf expref: 346 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.166689:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8c200, rc 0) 00000100:00100000:1.0:1769074918.166781:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67118:x1855007616022656:12345-192.168.204.32@tcp:101:rm.0 Request processed in 630us (7054us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.166789:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9159 00000100:00100000:3.0:1769074918.169522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.170290:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616022912 00000100:00100000:2.0:1769074918.170307:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616022912 00000100:00100000:2.0:1769074918.170422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9160 00000100:00100000:2.0:1769074918.170444:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67118:x1855007616022912:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.170472:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.170780:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7dea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e293fe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.170872:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.170904:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.170918:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.170934:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.170941:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.170948:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171016:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171024:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171031:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171038:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171045:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.171050:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171058:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171072:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.171075:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.171081:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171087:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7df1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171101:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171106:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171111:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171116:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.171119:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171128:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604e24c700) 00010000:00010000:2.0:1769074918.171136:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.171138:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171144:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7df8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.171181:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7dea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293fe expref: 346 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.171193:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.171196:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.171200:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7dea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e293fe expref: 346 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.171209:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adaa00, rc 0) 00000100:00100000:2.0:1769074918.171310:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67118:x1855007616022912:12345-192.168.204.32@tcp:101:rm.0 Request processed in 869us (1802us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.171320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9160 00000100:00100000:3.0:1769074918.184794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.184846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.184960:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023168 00000100:00100000:1.0:1769074918.184974:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023168 00000100:00100000:1.0:1769074918.185046:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:1.0:1769074918.185057:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616023168:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074918.185126:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.185151:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7dff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2940c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.185230:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074918.185249:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185262:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185295:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074918.185303:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185309:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185379:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185386:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185393:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185399:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.185405:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185412:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185426:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.185430:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.185436:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185443:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7e06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185459:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185465:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185471:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185476:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.185479:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185485:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185492:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604ec78600) 00010000:00010000:1.0:1769074918.185494:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.185497:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185503:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7e0d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074918.185588:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7dff lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2940c expref: 346 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.185599:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.185602:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074918.185606:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7dff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2940c expref: 346 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.185616:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc -2) 00000100:00100000:1.0:1769074918.185692:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616023168:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 637us (845us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074918.185700:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:2.0:1769074918.185919:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023040 00000100:00100000:2.0:1769074918.185926:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023040 00000100:00100000:2.0:1769074918.185971:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9161 00000100:00100000:2.0:1769074918.185981:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67121:x1855007616023040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.185992:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.186005:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e14 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29405 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.186049:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.186060:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186068:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186081:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.186087:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186093:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186121:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186127:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186132:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186136:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.186140:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186145:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186155:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.186158:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.186161:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186167:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186177:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186183:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186190:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186196:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.186198:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186217:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186224:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604e24c700) 00010000:00010000:2.0:1769074918.186226:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.186229:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186235:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e22 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.186259:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e14 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29405 expref: 346 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.186280:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.186283:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.186286:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e14 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29405 expref: 346 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.186295:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adaa00, rc 0) 00000100:00100000:2.0:1769074918.186328:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67121:x1855007616023040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 349us (1550us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.186334:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9161 00000100:00100000:1.0:1769074918.191242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.191346:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023296 00000100:00100000:0.0:1769074918.191361:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023296 00000100:00100000:0.0:1769074918.191447:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9162 00000100:00100000:0.0:1769074918.191460:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67121:x1855007616023296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.191487:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.191523:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29444 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.191634:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.191651:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191663:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191678:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.191684:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191690:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191754:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191761:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191767:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191773:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.191778:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191787:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191801:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.191805:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.191810:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191815:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e30 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191830:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191835:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191842:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191846:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.191848:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191853:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191859:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.191861:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.191864:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191868:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e37 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.191916:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e29 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29444 expref: 346 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.191927:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.191929:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.191933:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29444 expref: 346 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.191941:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a200, rc 0) 00000100:00100000:0.0:1769074918.192017:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67121:x1855007616023296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 560us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.192024:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9162 00000100:00100000:3.0:1769074918.199236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.199381:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023552 00000100:00100000:2.0:1769074918.199395:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023552 00000100:00100000:2.0:1769074918.199483:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9163 00000100:00100000:2.0:1769074918.199508:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67121:x1855007616023552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.199577:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.199604:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e3e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2944b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.199762:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.199781:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.199796:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.199812:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdda882ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.199824:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.199830:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074918.200221:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa0:0x0], index 1: 0 00010000:00010000:2.0:1769074918.200419:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7e53 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x149:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.200429:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7e53 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200437:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7e53 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200477:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200485:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200492:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200499:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.200504:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200512:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200526:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.200560:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.200566:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200573:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e45 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074918.200588:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015b09d26 reply state 0000000021e6e392 transno 4294968942 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200598:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.200604:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604e24c700) 00010000:00010000:2.0:1769074918.200607:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074918.200609:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074918.200646:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e3e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2944b expref: 348 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.200659:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada800/0x557988ac98fe7e53 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x149:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2944b expref: 347 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.200666:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x149:0x0].0x0 (ffff91604e24c600) 00010000:00010000:2.0:1769074918.200668:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074918.200671:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada800, rc 0) 00000100:00100000:2.0:1769074918.200752:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+348:67121:x1855007616023552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1259us (1530us total) trans 4294968942 rc 0/0 00000100:00100000:2.0:1769074918.200761:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9163 00000100:00100000:3.0:1769074918.205468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.205630:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023680 00000100:00100000:2.0:1769074918.205645:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023680 00000100:00100000:2.0:1769074918.205714:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2629 00000100:00100000:2.0:1769074918.205726:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+137:2419:x1855007616023680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.205750:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.205779:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29452 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074918.205807:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074918.205832:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.205835:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.205846:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 138 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.205868:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 138 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.205897:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb200, rc 0) 00000100:00100000:2.0:1769074918.205971:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2419:x1855007616023680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 248us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074918.205979:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2629 00000100:00100000:1.0:1769074918.213319:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.213442:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023808 00000100:00100000:0.0:1769074918.213456:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023808 00000100:00100000:0.0:1769074918.213577:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2630 00000100:00100000:0.0:1769074918.213589:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:67121:x1855007616023808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.213611:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.213636:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29459 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.213675:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 139 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.213684:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.213686:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.213691:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29459 expref: 139 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.213748:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 139 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.213765:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 139 pid: 25313 timeout: 2007 lvb_type: 1 00000100:00100000:0.0:1769074918.213779:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626609536:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074918.213913:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1180 going to sleep for 11 seconds 00000100:00100000:3.0:1769074918.216907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.217033:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616023936 00000100:00100000:1.0:1769074918.217046:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616023936 00010000:00010000:1.0:1769074918.217118:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 140 pid: 25313 timeout: 2007 lvb_type: 1 00000100:00100000:1.0:1769074918.217174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1843 00000100:00100000:1.0:1769074918.217187:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2419:x1855007616023936:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074918.217207:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074918.217236:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 140 pid: 25313 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.217252:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 140 pid: 25313 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.217296:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.217299:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.217308:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29459 expref: 140 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.217319:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29459 expref: 140 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.217368:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29459 expref: 140 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074918.217385:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626609664:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074918.217509:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160458933c0 going to sleep for 11 seconds 00010000:00010000:0.0:1769074918.218341:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052adb200/0x557988ac98fe7e61 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29452 expref: 140 pid: 25313 timeout: 2007 lvb_type: 1 00000100:00100000:0.0:1769074918.218364:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626609536:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074918.218402:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b4a200/0x557988ac98fe7e68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29459 expref: 139 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.218415:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a200, rc 0) 00000100:00100000:0.0:1769074918.218485:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:67121:x1855007616023808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4898us (5181us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.218505:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2630 00000100:00100000:3.0:1769074918.223168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.223318:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626609664:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074918.223354:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074918.223438:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2419:x1855007616023936:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6253us (6546us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.223452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1843 00000100:00100000:0.0:1769074918.223585:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024192 00000100:00100000:0.0:1769074918.223595:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024192 00000100:00100000:0.0:1769074918.223654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1828 00000100:00100000:0.0:1769074918.223664:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+348:67121:x1855007616024192:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074918.223997:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67121:x1855007616024192:12345-192.168.204.32@tcp:35:cp.0 Request processed in 333us (844us total) trans 4294968943 rc 0/0 00000100:00100000:0.0:1769074918.224006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1828 00000100:00100000:3.0:1769074918.246651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.246871:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024320 00000100:00100000:2.0:1769074918.246897:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024320 00000100:00100000:2.0:1769074918.246976:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:2.0:1769074918.246988:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2418:x1855007616024320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.247060:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.247088:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e6f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29460 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.247168:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.247190:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247202:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247222:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.247228:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247235:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247315:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247323:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247330:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247336:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.247341:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247349:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247364:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.247367:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.247374:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247407:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7e76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247422:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247428:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247433:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247439:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.247442:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247448:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247455:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91618163cc00) 00010000:00010000:2.0:1769074918.247458:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.247461:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247467:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7e7d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.247512:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e6f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29460 expref: 350 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.247522:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.247525:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.247561:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29460 expref: 350 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.247572:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adaa00, rc -2) 00000100:00100000:2.0:1769074918.247649:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2418:x1855007616024320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 664us (1013us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.247658:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:3.0:1769074918.260404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.260590:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024448 00000100:00100000:0.0:1769074918.260605:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024448 00000100:00100000:0.0:1769074918.260686:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9164 00000100:00100000:0.0:1769074918.260698:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67128:x1855007616024448:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074918.260726:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.260755:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29498 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.260840:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.260858:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.260870:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.260886:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.260892:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.260899:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.260990:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.260998:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261005:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261011:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.261016:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261024:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261038:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.261041:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.261047:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261053:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7e8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261068:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261074:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261081:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261087:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.261090:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261096:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261109:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.261111:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.261115:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261121:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7e92 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.261162:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e84 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29498 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.261173:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.261176:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.261180:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7e84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29498 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.261191:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a600, rc 0) 00000100:00100000:0.0:1769074918.261280:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67128:x1855007616024448:12345-192.168.204.32@tcp:101:bash.0 Request processed in 583us (892us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.261289:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9164 00000100:00100000:3.0:1769074918.274466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.274782:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024576 00000100:00100000:2.0:1769074918.274795:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024576 00000100:00100000:2.0:1769074918.274870:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9165 00000100:00100000:2.0:1769074918.274999:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67129:x1855007616024576:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.275026:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.275053:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e99 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2949f expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.275148:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.275166:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275179:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275195:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.275201:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275207:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275288:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275295:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275301:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275308:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.275313:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275320:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275334:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.275338:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.275343:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275349:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ea0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275365:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275371:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275377:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275382:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.275386:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275392:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275399:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff91618163cc00) 00010000:00010000:2.0:1769074918.275402:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.275404:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275410:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ea7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.275769:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e99 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2949f expref: 350 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.275783:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.275785:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.275789:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adaa00/0x557988ac98fe7e99 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2949f expref: 350 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.275799:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adaa00, rc 0) 00000100:00100000:2.0:1769074918.275965:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67129:x1855007616024576:12345-192.168.204.32@tcp:101:rm.0 Request processed in 969us (1511us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.275975:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9165 00000100:00100000:3.0:1769074918.280287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.281110:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024704 00000100:00100000:0.0:1769074918.281127:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024704 00000100:00100000:0.0:1769074918.281247:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 96 00000100:00100000:0.0:1769074918.281259:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2420:x1855007616024704:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074918.281341:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.281367:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7eae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e294a6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.281800:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.281819:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281832:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281849:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.281856:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281861:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281942:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281948:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281955:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281961:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.281966:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281974:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.281991:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.281995:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.282001:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282006:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7eb5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282021:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282026:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282031:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282036:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.282039:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282045:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282052:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.282054:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.282057:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282062:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7ebc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.282098:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7eae lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294a6 expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.282109:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.282112:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074918.282115:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7eae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294a6 expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.282125:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a600, rc -2) 00000100:00100000:0.0:1769074918.282224:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2420:x1855007616024704:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 967us (1961us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074918.282233:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 96 00000100:00100000:3.0:1769074918.285866:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.286056:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024832 00000100:00100000:1.0:1769074918.286070:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024832 00000100:00100000:1.0:1769074918.286141:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9166 00000100:00100000:1.0:1769074918.286154:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67129:x1855007616024832:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074918.286180:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.286209:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ec3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e294de expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.286309:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.286328:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286341:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286358:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.286364:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286370:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286444:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286453:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286460:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286467:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.286471:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286480:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286495:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.286498:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.286505:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286510:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7eca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286527:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286560:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286565:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286570:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.286573:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286578:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286589:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff91604ec78600) 00010000:00010000:1.0:1769074918.286591:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.286594:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286598:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7ed1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.286633:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ec3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294de expref: 350 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.286643:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.286645:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.286649:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7ec3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294de expref: 350 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.286657:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ce00, rc 0) 00000100:00100000:1.0:1769074918.286724:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67129:x1855007616024832:12345-192.168.204.32@tcp:101:rm.0 Request processed in 574us (874us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.286733:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9166 00000100:00100000:3.0:1769074918.305944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.306130:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616024960 00000100:00100000:0.0:1769074918.306145:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616024960 00000100:00100000:0.0:1769074918.306225:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9167 00000100:00100000:0.0:1769074918.306236:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67132:x1855007616024960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.306294:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.306324:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7ed8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e294e5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.306413:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.306441:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306455:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306473:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.306484:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306490:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306817:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306826:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306833:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306839:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.306844:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306852:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306868:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.306871:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.306888:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306895:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4bc00/0x557988ac98fe7edf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306914:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306920:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306927:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306932:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.306935:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306940:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306948:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.306950:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.306953:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306958:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe7ee6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.306999:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7ed8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294e5 expref: 350 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.307010:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.307012:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.307016:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe7ed8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294e5 expref: 350 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.307027:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a600, rc 0) 00000100:00100000:0.0:1769074918.307115:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67132:x1855007616024960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 881us (1187us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.307124:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9167 00000100:00100000:3.0:1769074918.309802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.310141:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025088 00000100:00100000:0.0:1769074918.310154:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025088 00000100:00100000:0.0:1769074918.310226:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:0.0:1769074918.310235:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2420:x1855007616025088:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074918.310316:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.310345:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe7eed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e294ec expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.310419:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.310447:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310460:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310478:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.310484:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310489:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310594:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310601:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310609:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310618:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1b5400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.310623:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310632:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310647:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.310650:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.310656:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310662:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe7ef4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310676:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310682:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310686:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310691:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.310694:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310699:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310705:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916044ae0a00) 00010000:00010000:0.0:1769074918.310708:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.310711:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310717:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe7efb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.310751:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe7eed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294ec expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.310760:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.310763:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074918.310766:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe7eed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e294ec expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.310778:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc -2) 00000100:00100000:0.0:1769074918.310865:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2420:x1855007616025088:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 629us (1075us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074918.310873:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:3.0:1769074918.315176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.315295:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025216 00000100:00100000:0.0:1769074918.315310:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025216 00000100:00100000:0.0:1769074918.315394:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9168 00000100:00100000:0.0:1769074918.315406:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67132:x1855007616025216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.315444:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.315472:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe7f02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29524 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.315615:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.315632:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315645:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315660:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.315666:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315671:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315736:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315744:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315750:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315756:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ece00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.315761:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315770:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315783:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.315787:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.315792:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315799:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315815:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315822:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315828:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315833:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.315837:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315843:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315850:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff916044ae0700) 00010000:00010000:0.0:1769074918.315853:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.315856:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315861:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe7f10 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.315900:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe7f02 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29524 expref: 350 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.315911:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.315913:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.315917:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe7f02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29524 expref: 350 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.315931:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42200, rc 0) 00000100:00100000:0.0:1769074918.316006:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67132:x1855007616025216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 601us (845us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.316013:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9168 00000100:00100000:3.0:1769074918.321043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.321303:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025472 00000100:00100000:1.0:1769074918.321318:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025472 00000100:00100000:1.0:1769074918.321441:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9169 00000100:00100000:1.0:1769074918.321454:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67132:x1855007616025472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.321481:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.321523:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7f17 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2952b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.321721:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.321740:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.321752:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.321772:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x17737191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.321780:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.321787:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074918.322257:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa0:0x0], index 0: 0 00010000:00010000:1.0:1769074918.322462:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7f2c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.322473:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7f2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322482:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7f2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322521:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322558:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322571:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322578:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.322583:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322591:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322606:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.322610:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.322615:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322620:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f1e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074918.322637:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ce819ff0 reply state 00000000261a0882 transno 4294968944 ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322649:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.322655:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff91604ec78600) 00010000:00010000:1.0:1769074918.322658:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074918.322661:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074918.322698:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7f17 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2952b expref: 352 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.322717:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8c200/0x557988ac98fe7f2c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2952b expref: 351 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.322730:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14a:0x0].0x0 (ffff91604ec78700) 00010000:00010000:1.0:1769074918.322733:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074918.322735:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8c200, rc 0) 00000100:00100000:1.0:1769074918.322836:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67132:x1855007616025472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1385us (1810us total) trans 4294968944 rc 0/0 00000100:00100000:1.0:1769074918.322846:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9169 00000100:00100000:3.0:1769074918.327138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.327337:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025600 00000100:00100000:0.0:1769074918.327351:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025600 00000100:00100000:0.0:1769074918.327478:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2631 00000100:00100000:0.0:1769074918.327499:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616025600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.327524:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.327575:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29532 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074918.327606:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074918.327628:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.327630:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.327640:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.327660:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.327676:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc 0) 00000100:00100000:0.0:1769074918.327740:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2420:x1855007616025600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 253us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.327748:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2631 00000100:00100000:3.0:1769074918.330505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.330978:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025728 00000100:00100000:2.0:1769074918.330992:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025728 00000100:00100000:2.0:1769074918.331058:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2632 00000100:00100000:2.0:1769074918.331069:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:67132:x1855007616025728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.331097:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.331119:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29539 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.331154:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.331164:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.331166:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.331170:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29539 expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.331209:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.331225:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:2.0:1769074918.331242:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626609792:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074918.331374:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1769074918.334083:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626609792:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074918.334132:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29539 expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.334158:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adaa00, rc 0) 00000100:00100000:2.0:1769074918.334235:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:67132:x1855007616025728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3167us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074918.334247:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2632 00000100:00100000:3.0:1769074918.336336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.336444:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616025856 00000100:00100000:1.0:1769074918.336455:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616025856 00010000:00010000:1.0:1769074918.336556:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:1.0:1769074918.336595:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1844 00000100:00100000:1.0:1769074918.336604:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2419:x1855007616025856:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074918.336623:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074918.336649:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.336666:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.336695:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604d0ed000/0x557988ac98fe7f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29532 expref: 141 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.336714:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.336716:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.336725:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29539 expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.336737:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29539 expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.336784:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052adaa00/0x557988ac98fe7f41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29539 expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074918.336800:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626609920:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074918.337069:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074918.342806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.342955:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026112 00000100:00100000:2.0:1769074918.342967:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026112 00000100:00100000:2.0:1769074918.343028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1829 00000100:00100000:2.0:1769074918.343036:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67132:x1855007616026112:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074918.343403:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67132:x1855007616026112:12345-192.168.204.32@tcp:35:cp.0 Request processed in 366us (612us total) trans 4294968945 rc 0/0 00000100:00100000:2.0:1769074918.343412:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1829 00000100:00100000:0.0:1769074918.343726:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626609920:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074918.343756:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074918.343803:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2419:x1855007616025856:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7200us (7479us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.343812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1844 00000100:00100000:1.0:1769074918.362460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.362592:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026240 00000100:00100000:2.0:1769074918.362607:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026240 00000100:00100000:2.0:1769074918.362690:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1769074918.362702:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616026240:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.362791:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.362820:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29540 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.362899:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.362918:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.362933:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.362951:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.362958:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.362964:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363045:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363053:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363060:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363072:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.363077:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363086:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363100:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.363103:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.363109:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363116:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363131:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363136:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363141:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363147:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.363150:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363156:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363163:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff91618163cc00) 00010000:00010000:2.0:1769074918.363166:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.363168:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363173:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f56 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.363206:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f48 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29540 expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.363216:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.363219:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.363222:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29540 expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.363231:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc -2) 00000100:00100000:2.0:1769074918.363331:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616026240:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 632us (888us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.363339:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:3.0:1769074918.375132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.375325:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026368 00000100:00100000:1.0:1769074918.375339:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026368 00000100:00100000:1.0:1769074918.375420:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9170 00000100:00100000:1.0:1769074918.375441:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67139:x1855007616026368:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074918.375470:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.376010:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7f5d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29578 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.376107:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.376127:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376141:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376161:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074918.376169:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376175:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376246:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376254:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376262:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376279:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.376284:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376292:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376306:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.376309:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.376315:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376322:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe7f64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376338:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376344:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376350:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376354:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.376357:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376362:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376369:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff91604ec78100) 00010000:00010000:1.0:1769074918.376372:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.376376:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376381:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe7f6b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074918.376432:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7f5d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29578 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.376444:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.376447:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.376451:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe7f5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29578 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.376461:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:1.0:1769074918.376771:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67139:x1855007616026368:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1331us (1652us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.376781:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9170 00000100:00100000:3.0:1769074918.388070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.388127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.388222:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026624 00000100:00100000:0.0:1769074918.388236:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026624 00000100:00100000:0.0:1769074918.388328:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:0.0:1769074918.388340:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2417:x1855007616026624:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074918.388387:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.388414:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f72 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29586 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.388509:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.388572:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388586:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388604:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.388611:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388618:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388688:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388696:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388703:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388709:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.388713:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388722:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388735:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.388739:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.388745:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388750:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7f79 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388767:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388773:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388779:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388785:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.388788:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388798:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388804:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.388807:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.388810:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388815:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7f80 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.388850:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f72 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29586 expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.388860:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.388862:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074918.388866:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7f72 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29586 expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.388875:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ece00, rc -2) 00000100:00100000:0.0:1769074918.388957:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2417:x1855007616026624:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 619us (828us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074918.388965:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:2.0:1769074918.389066:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026496 00000100:00100000:2.0:1769074918.389072:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026496 00000100:00100000:2.0:1769074918.389114:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9171 00000100:00100000:2.0:1769074918.389121:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67140:x1855007616026496:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.389132:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.389144:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2957f expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.389186:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.389195:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389204:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389216:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.389222:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389228:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389255:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389273:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389280:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389285:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.389289:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389295:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389303:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.389306:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.389309:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389315:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe7f8e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389325:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389331:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389336:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389342:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.389345:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389351:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389358:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff91618163cc00) 00010000:00010000:2.0:1769074918.389361:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.389364:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389374:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7f95 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.389398:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f87 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2957f expref: 354 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.389407:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.389409:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.389413:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7f87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2957f expref: 354 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.389421:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:2.0:1769074918.389451:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67140:x1855007616026496:12345-192.168.204.32@tcp:101:rm.0 Request processed in 331us (1398us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.389457:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9171 00000100:00100000:3.0:1769074918.394628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.394750:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026752 00000100:00100000:2.0:1769074918.394764:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026752 00000100:00100000:2.0:1769074918.394841:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9172 00000100:00100000:2.0:1769074918.394852:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67140:x1855007616026752:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.394890:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.394919:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7f9c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2958d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.395010:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074918.395028:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395046:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395064:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074918.395071:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395077:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395144:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395152:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395160:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395166:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.395171:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395179:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395194:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.395197:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.395203:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395210:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe7fa3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395226:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395231:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395236:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395242:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.395244:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395250:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395256:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff9161748d2200) 00010000:00010000:2.0:1769074918.395259:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.395261:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395278:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe7faa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.395316:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7f9c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2958d expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.395327:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.395329:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.395333:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7f9c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2958d expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.395348:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:2.0:1769074918.395421:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67140:x1855007616026752:12345-192.168.204.32@tcp:101:rm.0 Request processed in 570us (809us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.395429:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9172 00000100:00100000:3.0:1769074918.413666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.413786:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616026880 00000100:00100000:2.0:1769074918.413801:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616026880 00000100:00100000:2.0:1769074918.413884:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9173 00000100:00100000:2.0:1769074918.413897:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67141:x1855007616026880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.413926:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.413957:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe7fb1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29594 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.414052:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.414071:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414085:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414102:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.414109:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414115:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414188:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414196:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414204:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414211:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.414216:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414225:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414239:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.414243:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.414249:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414256:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe7fb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414302:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414309:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414315:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414320:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.414324:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414329:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414336:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff9161748d2d00) 00010000:00010000:2.0:1769074918.414339:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.414342:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414347:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe7fbf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.414382:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe7fb1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29594 expref: 354 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.414392:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.414394:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.414398:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe7fb1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29594 expref: 354 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.414407:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499000, rc 0) 00000100:00100000:2.0:1769074918.414485:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67141:x1855007616026880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 591us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.414494:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9173 00000100:00100000:3.0:1769074918.418230:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.418357:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027008 00000100:00100000:2.0:1769074918.418372:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027008 00000100:00100000:2.0:1769074918.418457:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:2.0:1769074918.418468:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2417:x1855007616027008:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.418587:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.418614:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7fc6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2959b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.418695:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.418715:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418729:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418745:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.418751:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418757:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418827:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418835:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418842:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418849:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.418854:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418865:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418880:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.418883:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.418889:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418895:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7fcd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418913:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418918:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418924:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418929:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.418932:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418938:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418945:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff9161748d2100) 00010000:00010000:2.0:1769074918.418947:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.418950:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418955:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7fd4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.418990:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7fc6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2959b expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.419000:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.419002:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.419006:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe7fc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2959b expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.419018:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc -2) 00000100:00100000:2.0:1769074918.419112:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2417:x1855007616027008:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 645us (898us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.419121:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:3.0:1769074918.423041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.423214:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027136 00000100:00100000:0.0:1769074918.423229:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027136 00000100:00100000:0.0:1769074918.423323:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9174 00000100:00100000:0.0:1769074918.423336:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67141:x1855007616027136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.423368:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.423402:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7fdb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e295d3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.423512:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.423571:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423585:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423604:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.423610:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423617:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423687:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423695:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423702:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423709:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.423713:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423722:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423737:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.423740:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.423745:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423751:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe7fe2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423766:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423772:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423778:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423783:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.423786:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423792:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423799:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.423801:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.423803:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423808:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe7fe9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.423850:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7fdb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295d3 expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.423861:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.423863:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.423867:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ece00/0x557988ac98fe7fdb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295d3 expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.423887:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ece00, rc 0) 00000100:00100000:0.0:1769074918.423971:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67141:x1855007616027136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 638us (946us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.423998:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9174 00000100:00100000:3.0:1769074918.431312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.431442:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027392 00000100:00100000:2.0:1769074918.431456:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027392 00000100:00100000:2.0:1769074918.431570:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9175 00000100:00100000:2.0:1769074918.431582:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67141:x1855007616027392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.431609:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.431636:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ff0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e295da expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.431798:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.431816:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.431830:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.431852:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.431859:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.431865:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074918.432372:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa1:0x0], index 1: 0 00010000:00010000:2.0:1769074918.432606:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe8005 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.432619:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe8005 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432627:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe8005 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432669:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432676:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432681:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432687:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.432691:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432698:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432713:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.432716:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.432722:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432728:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe7ff7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074918.432742:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ab4f2c3 reply state 000000002eecd81e transno 4294968946 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432753:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.432758:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff9161748d2100) 00010000:00010000:2.0:1769074918.432761:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074918.432765:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074918.432808:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe7ff0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295da expref: 356 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.432825:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb200/0x557988ac98fe8005 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295da expref: 355 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.432832:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14b:0x0].0x0 (ffff9161748d2d00) 00010000:00010000:2.0:1769074918.432835:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074918.432838:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb200, rc 0) 00000100:00100000:2.0:1769074918.432938:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67141:x1855007616027392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1358us (1640us total) trans 4294968946 rc 0/0 00000100:00100000:2.0:1769074918.432947:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9175 00000100:00100000:3.0:1769074918.437212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.437910:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027520 00000100:00100000:1.0:1769074918.437926:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027520 00000100:00100000:1.0:1769074918.438147:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2633 00000100:00100000:1.0:1769074918.438159:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+138:2420:x1855007616027520:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.438183:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.438210:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e295e1 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074918.438238:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074918.438274:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.438277:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.438288:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 139 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.438308:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 139 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.438323:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074918.438448:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616027520:12345-192.168.204.32@tcp:101:cp.0 Request processed in 289us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.438457:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2633 00000100:00100000:3.0:1769074918.442554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.442633:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027648 00000100:00100000:0.0:1769074918.442646:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027648 00000100:00100000:0.0:1769074918.442718:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2634 00000100:00100000:0.0:1769074918.442729:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:67141:x1855007616027648:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.442754:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.442785:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e295e8 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.442830:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.442838:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.442841:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.442845:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e8 expref: 140 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.442897:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.442914:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 2007 lvb_type: 1 00000100:00100000:0.0:1769074918.442929:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626610048:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074918.443805:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1840 going to sleep for 11 seconds 00000100:00100000:2.0:1769074918.446941:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626610048:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074918.446993:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e8 expref: 140 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.447018:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ece00, rc 0) 00000100:00100000:2.0:1769074918.447083:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:67141:x1855007616027648:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4355us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074918.447093:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2634 00000100:00100000:2.0:1769074918.448761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.449906:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616027776 00000100:00100000:0.0:1769074918.449921:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616027776 00010000:00010000:0.0:1769074918.450001:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 2007 lvb_type: 1 00000100:00100000:0.0:1769074918.450051:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1845 00000100:00100000:0.0:1769074918.450062:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2420:x1855007616027776:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074918.450080:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074918.450107:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 2007 lvb_type: 1 00010000:00010000:0.0:1769074918.450122:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 2007 lvb_type: 1 00010000:00010000:0.0:1769074918.450152:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe8013 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e1 expref: 140 pid: 8625 timeout: 2007 lvb_type: 1 00010000:00010000:0.0:1769074918.450172:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.450174:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.450182:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e8 expref: 139 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.450192:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e8 expref: 139 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.450237:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d0ece00/0x557988ac98fe801a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295e8 expref: 139 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074918.450255:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626610176:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074918.450391:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074918.454781:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626610176:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074918.454823:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074918.454908:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616027776:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4847us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.454922:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1845 00000100:00100000:3.0:1769074918.460106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.460233:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028032 00000100:00100000:2.0:1769074918.460249:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028032 00000100:00100000:2.0:1769074918.460338:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1830 00000100:00100000:2.0:1769074918.460349:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181001450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67141:x1855007616028032:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074918.460829:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181001450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67141:x1855007616028032:12345-192.168.204.32@tcp:35:cp.0 Request processed in 480us (739us total) trans 4294968947 rc 0/0 00000100:00100000:2.0:1769074918.460839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1830 00000100:00100000:1.0:1769074918.478593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.479043:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028160 00000100:00100000:0.0:1769074918.479060:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028160 00000100:00100000:0.0:1769074918.479149:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 101 00000100:00100000:0.0:1769074918.479160:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2417:x1855007616028160:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074918.479237:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.479273:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8021 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e295ef expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.479349:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.479367:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479380:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479397:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074918.479403:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479409:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479482:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479490:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479496:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479502:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.479506:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479514:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479527:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.479570:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.479576:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479582:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8028 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479597:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479603:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479608:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479612:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.479614:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479619:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479625:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.479627:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.479630:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479635:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe802f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074918.479664:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8021 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295ef expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.479674:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.479676:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074918.479680:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8021 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e295ef expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.479693:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc -2) 00000100:00100000:0.0:1769074918.479784:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2417:x1855007616028160:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 626us (1265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074918.479792:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 101 00000100:00100000:3.0:1769074918.506768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.506907:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028288 00000100:00100000:0.0:1769074918.506921:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028288 00000100:00100000:0.0:1769074918.507008:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9176 00000100:00100000:0.0:1769074918.507020:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67149:x1855007616028288:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074918.507050:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.507078:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8036 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29627 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.507173:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.507192:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507206:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507222:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.507229:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507235:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507319:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507327:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507334:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507342:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.507347:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507355:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507370:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.507373:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.507379:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507385:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe803d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507401:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507407:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507413:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507417:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.507420:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507426:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507432:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.507435:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.507437:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507442:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8044 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.507480:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8036 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29627 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.507491:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.507493:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.507497:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8036 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29627 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.507507:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074918.507651:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67149:x1855007616028288:12345-192.168.204.32@tcp:101:bash.0 Request processed in 632us (897us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.507659:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9176 00000100:00100000:3.0:1769074918.515715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.515846:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028416 00000100:00100000:2.0:1769074918.515861:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028416 00000100:00100000:2.0:1769074918.515943:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9177 00000100:00100000:2.0:1769074918.515956:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67150:x1855007616028416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.515985:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.516013:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe804b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2962e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.516106:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.516124:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516139:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516156:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.516161:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516168:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516236:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516243:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516249:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516256:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.516272:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516290:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516304:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.516307:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.516312:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516318:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8052 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516334:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516339:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516345:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516349:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.516352:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516357:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516364:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff9161748d2200) 00010000:00010000:2.0:1769074918.516366:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.516368:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516373:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8059 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.516409:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe804b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2962e expref: 358 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.516419:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.516420:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.516424:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe804b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2962e expref: 358 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.516438:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb000, rc 0) 00000100:00100000:2.0:1769074918.516522:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67150:x1855007616028416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 568us (822us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.516601:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9177 00000100:00100000:1.0:1769074918.517845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.518143:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028544 00000100:00100000:2.0:1769074918.518153:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028544 00000100:00100000:2.0:1769074918.518288:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:2.0:1769074918.518299:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2418:x1855007616028544:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.518339:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.518362:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8060 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29635 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.518422:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.518436:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518447:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518460:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.518466:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518471:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518527:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518582:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518589:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518595:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.518599:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518607:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518619:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.518623:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.518627:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518632:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8067 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518660:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518667:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518671:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518675:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.518679:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518683:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518690:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff9161748d2700) 00010000:00010000:2.0:1769074918.518692:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.518695:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518700:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe806e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.518728:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8060 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29635 expref: 358 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.518737:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.518739:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.518742:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8060 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29635 expref: 358 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.518750:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc -2) 00000100:00100000:2.0:1769074918.518816:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2418:x1855007616028544:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 520us (983us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.518823:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:3.0:1769074918.523226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.523439:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028672 00000100:00100000:0.0:1769074918.523454:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028672 00000100:00100000:0.0:1769074918.523572:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9178 00000100:00100000:0.0:1769074918.523584:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67150:x1855007616028672:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074918.523609:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.523628:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8075 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2963c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.523714:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.523730:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523742:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523757:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.523764:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523770:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523824:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523833:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523840:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523846:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.523851:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523862:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523873:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.523876:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.523892:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523899:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe807c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523913:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523919:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523925:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523929:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.523943:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523956:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523964:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.523967:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.523970:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.523976:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8083 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.524007:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8075 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2963c expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.524017:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.524019:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.524023:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8075 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2963c expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.524032:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074918.524090:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67150:x1855007616028672:12345-192.168.204.32@tcp:101:rm.0 Request processed in 508us (882us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.524098:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9178 00000100:00100000:3.0:1769074918.542630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.542739:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028800 00000100:00100000:2.0:1769074918.542754:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028800 00000100:00100000:2.0:1769074918.542818:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9179 00000100:00100000:2.0:1769074918.542828:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67151:x1855007616028800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.542852:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.542873:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe808a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29643 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.542950:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.542964:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.542975:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.542990:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.542996:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543002:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543050:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543057:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543063:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543069:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.543073:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543083:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543095:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.543099:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.543103:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543108:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8091 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543121:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543126:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543131:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543136:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.543139:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543145:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543152:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff9161748d2700) 00010000:00010000:2.0:1769074918.543155:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.543157:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543163:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499000/0x557988ac98fe8098 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.543192:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe808a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29643 expref: 358 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.543203:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.543205:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.543208:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe808a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29643 expref: 358 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.543217:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc 0) 00000100:00100000:2.0:1769074918.543296:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67151:x1855007616028800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 468us (680us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.543304:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9179 00000100:00100000:1.0:1769074918.550926:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.551114:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616028928 00000100:00100000:0.0:1769074918.551131:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616028928 00000100:00100000:0.0:1769074918.551220:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9180 00000100:00100000:0.0:1769074918.551232:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67151:x1855007616028928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.551270:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.551306:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe809f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2964a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.551662:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.551682:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551695:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551716:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.551723:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551729:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551804:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551812:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551819:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551825:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.551829:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551839:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551853:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.551856:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.551862:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551868:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551882:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551887:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551893:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551897:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.551900:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551905:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551911:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.551914:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.551916:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551922:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.551958:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe809f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2964a expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.551969:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.551971:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.551974:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe809f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2964a expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.551983:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074918.552112:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67151:x1855007616028928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 883us (1201us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.552121:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9180 00000100:00100000:3.0:1769074918.556331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.556428:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029184 00000100:00100000:0.0:1769074918.556443:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029184 00000100:00100000:0.0:1769074918.556520:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9181 00000100:00100000:0.0:1769074918.556817:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67151:x1855007616029184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.556846:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.556884:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe80b4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29651 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.557052:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.557072:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.557086:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.557103:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x4985395f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.557109:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.557115:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074918.557796:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa1:0x0], index 0: 0 00010000:00010000:0.0:1769074918.558114:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe80c9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.558129:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe80c9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558139:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe80c9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558178:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558184:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558191:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558197:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.558202:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558209:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558223:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.558226:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.558232:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558238:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80bb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074918.558254:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000736821c6 reply state 00000000a72254a4 transno 4294968948 ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558486:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.558496:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff91604e401b00) 00010000:00010000:0.0:1769074918.558499:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074918.558503:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074918.558658:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe80b4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29651 expref: 360 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.558675:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42e00/0x557988ac98fe80c9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29651 expref: 359 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.558683:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14c:0x0].0x0 (ffff91604e401800) 00010000:00010000:0.0:1769074918.558685:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074918.558688:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42e00, rc 0) 00000100:00100000:0.0:1769074918.558841:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67151:x1855007616029184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2311us (2523us total) trans 4294968948 rc 0/0 00000100:00100000:0.0:1769074918.558851:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9181 00000100:00100000:3.0:1769074918.565208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.569734:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029312 00000100:00100000:2.0:1769074918.569756:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029312 00000100:00100000:2.0:1769074918.569902:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2635 00000100:00100000:2.0:1769074918.569915:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2420:x1855007616029312:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.569942:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.569970:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29658 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074918.570003:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074918.570033:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.570036:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.570047:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.570068:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.570086:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc 0) 00000100:00100000:2.0:1769074918.570180:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2420:x1855007616029312:12345-192.168.204.32@tcp:101:cp.0 Request processed in 266us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074918.570189:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2635 00000100:00100000:1.0:1769074918.579435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.579596:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029440 00000100:00100000:2.0:1769074918.579610:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029440 00000100:00100000:2.0:1769074918.579677:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2636 00000100:00100000:2.0:1769074918.579740:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:67151:x1855007616029440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.579764:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.579788:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2965f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.579826:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.579835:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.579837:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074918.579842:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2965f expref: 142 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.579885:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074918.579902:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:2.0:1769074918.579926:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626610304:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074918.579968:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074918.580077:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd240 going to sleep for 11 seconds 00000100:00100000:2.0:1769074918.583904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.586748:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626610304:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074918.586801:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2965f expref: 142 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.586828:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499000, rc 0) 00000100:00100000:0.0:1769074918.586942:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:67151:x1855007616029440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7253us (7522us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074918.586953:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2636 00000100:00100000:1.0:1769074918.587052:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029568 00000100:00100000:1.0:1769074918.587063:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029568 00010000:00010000:1.0:1769074918.587132:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 2007 lvb_type: 1 00000100:00100000:1.0:1769074918.587173:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1846 00000100:00100000:1.0:1769074918.587182:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2420:x1855007616029568:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074918.587198:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074918.587223:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.587238:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.587669:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f499c00/0x557988ac98fe80d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29658 expref: 142 pid: 8405 timeout: 2007 lvb_type: 1 00010000:00010000:1.0:1769074918.587688:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.587690:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.587700:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2965f expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.587711:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2965f expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.587757:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f499000/0x557988ac98fe80de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2965f expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074918.587774:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626610432:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074918.588244:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074918.590887:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626610432:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074918.590927:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074918.591001:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916180fe5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2420:x1855007616029568:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3818us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.591013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1846 00000100:00100000:0.0:1769074918.594050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.594984:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029824 00000100:00100000:1.0:1769074918.595000:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029824 00000100:00100000:0.0:1769074918.595187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1831 00000100:00100000:0.0:1769074918.595199:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67151:x1855007616029824:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074918.595764:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67151:x1855007616029824:12345-192.168.204.32@tcp:35:cp.0 Request processed in 565us (1727us total) trans 4294968949 rc 0/0 00000100:00100000:0.0:1769074918.595777:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1831 00000100:00100000:3.0:1769074918.643746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.644527:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616029952 00000100:00100000:0.0:1769074918.644591:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616029952 00000100:00100000:0.0:1769074918.644678:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9182 00000100:00100000:0.0:1769074918.644690:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67154:x1855007616029952:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074918.644718:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.644745:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe80e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29666 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.644836:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.644855:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644866:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644882:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.644889:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644894:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644960:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644966:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644971:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644975:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.644978:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644983:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.644994:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.644997:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.645001:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645004:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe80ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645015:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645018:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645022:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645025:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.645026:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645029:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645036:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604e401400) 00010000:00010000:0.0:1769074918.645038:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.645040:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645043:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe80f3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.645070:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe80e5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29666 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.645077:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.645078:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.645080:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe80e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29666 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.645086:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074918.645160:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67154:x1855007616029952:12345-192.168.204.32@tcp:101:bash.0 Request processed in 472us (1430us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.645170:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9182 00000100:00100000:2.0:1769074918.654229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.654313:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030080 00000100:00100000:0.0:1769074918.654329:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030080 00000100:00100000:0.0:1769074918.654418:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9183 00000100:00100000:0.0:1769074918.654431:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67155:x1855007616030080:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074918.654467:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.654499:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2966d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.654650:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.654670:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654686:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654704:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074918.654712:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654718:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654788:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654795:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654802:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654808:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.654813:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654822:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654844:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.654847:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.654854:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654860:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8101 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654873:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654879:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654884:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654889:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.654891:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654896:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654902:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604e401400) 00010000:00010000:0.0:1769074918.654904:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.654907:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654911:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe8108 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.654947:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80fa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2966d expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.654957:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.654960:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.654963:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe80fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2966d expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.654973:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc 0) 00000100:00100000:0.0:1769074918.655053:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67155:x1855007616030080:12345-192.168.204.32@tcp:101:rm.0 Request processed in 624us (839us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.655063:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9183 00000100:00100000:3.0:1769074918.659080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.659127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.659406:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030208 00000100:00100000:2.0:1769074918.659429:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030208 00000100:00100000:2.0:1769074918.659501:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:2.0:1769074918.659513:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2418:x1855007616030208:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074918.659608:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.659635:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe810f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29674 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074918.659722:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030336 00010000:00010000:2.0:1769074918.659727:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00000100:00100000:0.0:1769074918.659728:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030336 00010000:00010000:2.0:1769074918.659745:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.659758:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.659775:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074918.659783:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.659789:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00000100:00100000:0.0:1769074918.659813:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9184 00000100:00100000:0.0:1769074918.659821:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67155:x1855007616030336:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074918.659830:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.659839:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8124 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2967b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.659864:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074918.659873:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074918.659948:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.659957:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074918.662203:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.662277:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.662286:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.662286:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662298:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662313:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.662317:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.662322:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074918.662327:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074918.662328:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8116 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074918.662339:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662345:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074918.662352:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662357:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662363:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662368:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.662371:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662376:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662382:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff9161748d2600) 00010000:00010000:2.0:1769074918.662384:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.662387:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074918.662393:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe811d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074918.662624:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662631:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662637:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662641:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.662644:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662650:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662658:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.662661:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.662663:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662670:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe812b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662682:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662687:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662693:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662697:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1b5400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074918.662700:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662705:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662712:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff916044ae0f00) 00010000:00010000:0.0:1769074918.662714:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.662717:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662722:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8132 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074918.662764:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8124 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2967b expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.662775:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074918.662778:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074918.662782:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8124 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2967b expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.662792:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ede00, rc 0) 00000100:00100000:0.0:1769074918.662898:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67155:x1855007616030336:12345-192.168.204.32@tcp:101:rm.0 Request processed in 3077us (3767us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074918.662908:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9184 00010000:00010000:2.0:1769074918.663073:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe810f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29674 expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.663084:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.663086:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074918.663089:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe810f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29674 expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.663097:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc -2) 00000100:00100000:2.0:1769074918.663153:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2418:x1855007616030208:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3643us (4090us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074918.663163:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:3.0:1769074918.685838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.687928:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030464 00000100:00100000:0.0:1769074918.687951:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030464 00000100:00100000:1.0:1769074918.688192:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9185 00000100:00100000:1.0:1769074918.688206:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67156:x1855007616030464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.688236:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.688276:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8139 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29682 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.688372:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.688391:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688404:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688432:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.688438:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688445:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688807:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688817:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688824:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688831:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.688836:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688845:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688862:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.688866:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.688882:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688890:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8140 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688909:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688914:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688918:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688923:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.688927:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688932:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688940:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff91604ec78b00) 00010000:00010000:1.0:1769074918.688942:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.688945:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688951:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8147 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.688996:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8139 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29682 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.689007:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.689009:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.689013:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8139 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29682 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.689022:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074918.689128:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67156:x1855007616030464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 923us (3305us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.689136:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9185 00000100:00100000:3.0:1769074918.693362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.694126:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030592 00000100:00100000:1.0:1769074918.694142:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030592 00000100:00100000:1.0:1769074918.694642:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9186 00000100:00100000:1.0:1769074918.694657:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67156:x1855007616030592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.694688:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.694730:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe814e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29689 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.694854:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.694883:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.694895:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.694931:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.694939:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.694944:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695010:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695016:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695022:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695029:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.695034:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695046:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695060:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.695063:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.695069:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695075:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8155 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695090:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695096:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695102:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695106:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.695109:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695114:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695120:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff916052b4c200) 00010000:00010000:1.0:1769074918.695122:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.695124:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695129:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe815c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.695168:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe814e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29689 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.695180:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.695183:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.695186:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe814e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29689 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.695197:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:1.0:1769074918.695308:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67156:x1855007616030592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 655us (1961us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.695317:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9186 00000100:00100000:0.0:1769074918.703420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.705354:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030848 00000100:00100000:1.0:1769074918.705376:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030848 00000100:00100000:1.0:1769074918.707369:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9187 00000100:00100000:1.0:1769074918.707395:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67156:x1855007616030848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.708476:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.708561:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe8163 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29690 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.708741:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.708760:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.708773:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.708797:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.708805:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.708811:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074918.709625:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa2:0x0], index 1: 0 00010000:00010000:1.0:1769074918.710253:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296800/0x557988ac98fe8178 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.710284:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296800/0x557988ac98fe8178 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710295:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296800/0x557988ac98fe8178 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710343:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710351:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710359:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710365:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.710370:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710379:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710395:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.710399:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.710405:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710410:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe816a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074918.710427:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006777b69 reply state 00000000f9775b71 transno 4294968950 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710438:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.710444:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff916052b4c800) 00010000:00010000:1.0:1769074918.710446:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074918.710450:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074918.710497:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe8163 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29690 expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.710514:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296800/0x557988ac98fe8178 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29690 expref: 363 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.710522:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14d:0x0].0x0 (ffff916052b4ca00) 00010000:00010000:1.0:1769074918.710524:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074918.710527:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296800, rc 0) 00000100:00100000:1.0:1769074918.710680:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67156:x1855007616030848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3295us (7274us total) trans 4294968950 rc 0/0 00000100:00100000:1.0:1769074918.710691:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9187 00000100:00100000:0.0:1769074918.714691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.714823:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616030976 00000100:00100000:1.0:1769074918.714840:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616030976 00000100:00100000:1.0:1769074918.714924:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2637 00000100:00100000:1.0:1769074918.714937:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+139:2420:x1855007616030976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.714963:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.714991:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29697 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074918.715025:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074918.715053:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.715056:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.715067:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.715089:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 140 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074918.715104:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074918.715180:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2420:x1855007616030976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 246us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.715188:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2637 00000100:00100000:3.0:1769074918.718840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.723370:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031104 00000100:00100000:0.0:1769074918.723392:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031104 00000100:00100000:0.0:1769074918.723581:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2638 00000100:00100000:0.0:1769074918.723593:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:67156:x1855007616031104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074918.723616:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074918.723644:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2969e expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.723682:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.723692:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.723694:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074918.723699:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2969e expref: 141 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074918.723755:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 141 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074918.723773:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 141 pid: 8405 timeout: 2008 lvb_type: 1 00000100:00100000:0.0:1769074918.723789:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626610560:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074918.723949:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5900 going to sleep for 11 seconds 00000100:00100000:0.0:1769074918.728672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.728895:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031232 00000100:00100000:1.0:1769074918.728904:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031232 00000100:00100000:3.0:1769074918.728921:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626610560:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074918.728967:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 142 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:3.0:1769074918.728967:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2969e expref: 142 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.728992:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4bc00, rc 0) 00000100:00100000:1.0:1769074918.729015:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1847 00000100:00100000:1.0:1769074918.729026:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2419:x1855007616031232:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074918.729055:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1769074918.729064:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:67156:x1855007616031104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5474us (10240us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074918.729072:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2638 00010000:00010000:1.0:1769074918.729082:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 142 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.729097:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 141 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.729125:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e296000/0x557988ac98fe8186 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29697 expref: 141 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.729140:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.729142:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.729151:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2969e expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.729162:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2969e expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.729203:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b4bc00/0x557988ac98fe818d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2969e expref: 140 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074918.729219:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626610688:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074918.729335:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074918.746270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.746507:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626610688:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074918.746579:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074918.746661:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2419:x1855007616031232:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 17634us (18003us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.746679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1847 00000100:00100000:2.0:1769074918.750702:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031488 00000100:00100000:2.0:1769074918.750816:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031488 00000100:00100000:2.0:1769074918.751064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1832 00000100:00100000:2.0:1769074918.751077:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67156:x1855007616031488:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074918.751593:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67156:x1855007616031488:12345-192.168.204.32@tcp:35:cp.0 Request processed in 516us (5348us total) trans 4294968951 rc 0/0 00000100:00100000:2.0:1769074918.751604:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1832 00000100:00100000:0.0:1769074918.783604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.783717:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031616 00000100:00100000:1.0:1769074918.783732:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031616 00000100:00100000:1.0:1769074918.783811:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9188 00000100:00100000:1.0:1769074918.783823:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67159:x1855007616031616:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074918.783851:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.784830:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8194 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296a5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.784922:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.784936:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.784948:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.784963:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.784969:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.784975:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785026:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785033:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785040:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785046:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.785050:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785057:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785069:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.785072:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.785077:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785083:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe819b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785099:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785104:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785110:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785114:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.785117:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785123:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785135:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916052b4c200) 00010000:00010000:1.0:1769074918.785137:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.785140:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785146:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe81a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.785183:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8194 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296a5 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.785193:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.785196:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.785200:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8194 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296a5 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.785208:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074918.785302:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67159:x1855007616031616:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1481us (1713us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.785312:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9188 00000100:00100000:3.0:1769074918.801694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.806590:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031872 00000100:00100000:2.0:1769074918.806630:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031872 00000100:00100000:3.0:1769074918.807094:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00100000:3.0:1769074918.807103:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2417:x1855007616031872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074918.807149:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.807172:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296b3 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.807246:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074918.807273:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807288:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807305:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074918.807311:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807317:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807400:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807408:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807424:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807436:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.807441:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807449:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807463:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.807467:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.807472:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.807478:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810605:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810626:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810634:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810641:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.810646:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810654:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810676:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604ecb7300) 00010000:00010000:3.0:1769074918.810679:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.810686:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810692:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81b7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.810774:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81a9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296b3 expref: 366 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.810785:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.810787:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074918.810791:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296b3 expref: 366 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.810800:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a600, rc -2) 00000100:00100000:3.0:1769074918.812318:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2417:x1855007616031872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 5199us (10624us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074918.812336:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00100000:0.0:1769074918.812828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.815193:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616031744 00000100:00100000:3.0:1769074918.815217:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616031744 00000100:00100000:3.0:1769074918.815360:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9189 00000100:00100000:3.0:1769074918.815372:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67160:x1855007616031744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074918.815409:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.815443:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81be lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296ac expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.815816:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074918.815839:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.815853:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.815958:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074918.815966:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.815974:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816120:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816129:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816136:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816143:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.816148:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816156:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816172:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.816175:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.816181:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816188:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe81c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816204:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816210:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816216:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816221:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.816224:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816231:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816238:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff91604ecb7b00) 00010000:00010000:3.0:1769074918.816241:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.816244:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816249:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe81cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.816307:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81be lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296ac expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.816319:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.816321:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.816325:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe81be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296ac expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.816341:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6be00, rc 0) 00000100:00100000:3.0:1769074918.816756:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67160:x1855007616031744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1382us (3926us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074918.816766:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9189 00000100:00100000:2.0:1769074918.819370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.819671:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032000 00000100:00100000:3.0:1769074918.819684:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032000 00000100:00100000:3.0:1769074918.819836:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9190 00000100:00100000:3.0:1769074918.819846:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67160:x1855007616032000:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074918.819993:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.820021:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296ba expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.820159:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074918.820176:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820188:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820203:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074918.820210:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820215:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820295:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820303:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820309:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820317:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.820322:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820330:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820344:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.820348:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.820354:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820361:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe81da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820374:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820380:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820617:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820622:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.820626:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820633:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820641:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff91604ecb7300) 00010000:00010000:3.0:1769074918.820644:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.820647:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820653:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b800/0x557988ac98fe81e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074918.820691:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81d3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296ba expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.820789:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.820792:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.820797:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe81d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296ba expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.820807:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a600, rc 0) 00000100:00100000:3.0:1769074918.820998:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67160:x1855007616032000:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1151us (1639us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074918.821008:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9190 00000100:00100000:0.0:1769074918.833340:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.833844:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032128 00000100:00100000:3.0:1769074918.833859:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032128 00000100:00100000:2.0:1769074918.834169:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9191 00000100:00100000:2.0:1769074918.834183:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67161:x1855007616032128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074918.834212:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.834240:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe81e8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296c1 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.834372:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.834402:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834424:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834440:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074918.834447:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834453:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834561:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834570:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834577:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834583:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.834588:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834597:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834610:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.834613:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.834618:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834624:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe81ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834642:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834648:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834654:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834658:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.834661:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834671:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834677:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff9161748d2600) 00010000:00010000:2.0:1769074918.834679:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.834682:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834687:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe81f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074918.834983:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe81e8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296c1 expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.834994:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.834997:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.835001:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe81e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296c1 expref: 366 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.835012:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074918.835165:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67161:x1855007616032128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 983us (1837us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.835175:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9191 00000100:00100000:3.0:1769074918.839339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.839448:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032256 00000100:00100000:1.0:1769074918.839464:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032256 00000100:00100000:1.0:1769074918.839584:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9192 00000100:00100000:1.0:1769074918.839595:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67161:x1855007616032256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.839621:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.839649:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe81fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296c8 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.840247:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.840278:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840293:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840309:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.840315:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840321:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840401:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840409:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840423:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840429:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.840434:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840441:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840459:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.840463:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.840469:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.840475:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8204 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841219:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841231:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841237:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841242:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.841246:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841252:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841276:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916052b4c200) 00010000:00010000:1.0:1769074918.841279:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.841282:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841288:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe820b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.841347:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe81fd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296c8 expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.841360:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.841363:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.841367:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe81fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296c8 expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.841377:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074918.842113:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67161:x1855007616032256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2512us (2779us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.842125:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9192 00000100:00100000:3.0:1769074918.847253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.847376:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032512 00000100:00100000:1.0:1769074918.847627:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032512 00000100:00100000:1.0:1769074918.847844:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9193 00000100:00100000:1.0:1769074918.847857:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67161:x1855007616032512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074918.847898:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.847927:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8212 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296cf expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.848085:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.848104:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.848118:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.848135:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x294e10fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.848147:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.848153:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074918.849156:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa2:0x0], index 0: 0 00010000:00010000:1.0:1769074918.849400:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297200/0x557988ac98fe8227 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.849418:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297200/0x557988ac98fe8227 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.849442:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297200/0x557988ac98fe8227 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.849484:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.850796:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.850813:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.850820:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.850825:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.850834:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.850851:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.850856:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.850862:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.851012:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8219 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074918.851037:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002169eb9b reply state 000000008eaad8a0 transno 4294968952 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.851052:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.851059:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916052b4cf00) 00010000:00010000:1.0:1769074918.851062:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074918.851066:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074918.851131:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8212 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296cf expref: 368 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.851148:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297200/0x557988ac98fe8227 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296cf expref: 367 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.851156:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14e:0x0].0x0 (ffff916052b4c000) 00010000:00010000:1.0:1769074918.851158:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074918.851162:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297200, rc 0) 00000100:00100000:1.0:1769074918.851317:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67161:x1855007616032512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3461us (4076us total) trans 4294968952 rc 0/0 00000100:00100000:1.0:1769074918.851327:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9193 00000100:00100000:0.0:1769074918.857068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.857176:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032640 00000100:00100000:3.0:1769074918.857192:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032640 00000100:00100000:3.0:1769074918.857309:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2639 00000100:00100000:3.0:1769074918.857322:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2418:x1855007616032640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074918.857349:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.857377:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296d6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074918.857589:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074918.857617:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074918.857621:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074918.857631:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074918.857655:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074918.857673:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a600, rc 0) 00000100:00100000:3.0:1769074918.857854:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2418:x1855007616032640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 533us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074918.857862:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2639 00000100:00100000:2.0:1769074918.869888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.870192:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032768 00000100:00100000:3.0:1769074918.870206:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032768 00000100:00100000:3.0:1769074918.870290:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2640 00000100:00100000:3.0:1769074918.870302:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:67161:x1855007616032768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074918.870328:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.870356:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296dd expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.870401:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074918.870411:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074918.870413:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074918.870427:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296dd expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.870475:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074918.870492:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074918.870508:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626610816:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074918.870698:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074918.874360:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626610816:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074918.874429:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296dd expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.874458:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b800, rc 0) 00000100:00100000:3.0:1769074918.874587:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:67161:x1855007616032768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4278us (4712us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074918.874598:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2640 00000100:00100000:2.0:1769074918.876794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.876882:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616032896 00000100:00100000:1.0:1769074918.876894:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616032896 00010000:00010000:1.0:1769074918.876967:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:1.0:1769074918.877017:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1848 00000100:00100000:1.0:1769074918.877029:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2419:x1855007616032896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074918.877049:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074918.877080:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.877097:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.877126:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a600/0x557988ac98fe8235 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296d6 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074918.877146:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.877149:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074918.877156:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296dd expref: 142 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.877169:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296dd expref: 142 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.877217:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6b800/0x557988ac98fe823c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296dd expref: 142 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074918.877230:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626610944:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074918.877348:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a540 going to sleep for 11 seconds 00000100:00100000:1.0:1769074918.880356:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626610944:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074918.880411:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074918.880486:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2419:x1855007616032896:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3457us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074918.880502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1848 00000100:00100000:2.0:1769074918.882653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074918.882767:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033152 00000100:00100000:0.0:1769074918.882780:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033152 00000100:00100000:0.0:1769074918.882855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1833 00000100:00100000:0.0:1769074918.882875:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67161:x1855007616033152:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074918.883301:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67161:x1855007616033152:12345-192.168.204.32@tcp:35:cp.0 Request processed in 434us (658us total) trans 4294968953 rc 0/0 00000100:00100000:0.0:1769074918.883310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1833 00000100:00100000:2.0:1769074918.944283:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.944584:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033280 00000100:00100000:1.0:1769074918.944600:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033280 00000100:00100000:1.0:1769074918.944737:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9194 00000100:00100000:1.0:1769074918.944750:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67164:x1855007616033280:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074918.944781:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.944811:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8243 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296e4 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.944902:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.944921:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.944936:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.944952:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.944959:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.944965:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945049:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945057:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945065:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945071:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.945075:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945083:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945098:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.945101:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.945107:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945113:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe824a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945128:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945133:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945139:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945142:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.945145:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945154:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945160:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff916052b4c200) 00010000:00010000:1.0:1769074918.945162:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.945164:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945168:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8251 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.945207:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8243 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296e4 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.945217:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.945220:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.945223:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8243 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296e4 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.945233:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296c00, rc 0) 00000100:00100000:1.0:1769074918.945329:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67164:x1855007616033280:12345-192.168.204.32@tcp:101:bash.0 Request processed in 581us (1060us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.945337:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9194 00000100:00100000:3.0:1769074918.960465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074918.960623:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033408 00000100:00100000:2.0:1769074918.960640:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033408 00000100:00100000:2.0:1769074918.960732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9195 00000100:00100000:2.0:1769074918.960743:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67165:x1855007616033408:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074918.960779:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074918.960807:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8258 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.960911:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.960930:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.960944:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.960959:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.960966:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.960972:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961046:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961054:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961060:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961067:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961073:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.961078:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961086:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.961102:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.961108:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961113:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe825f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961128:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961133:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961139:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961144:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074918.961146:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961151:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff9161748d2600) 00010000:00010000:2.0:1769074918.961160:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.961163:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961169:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe8266 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.961213:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8258 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296eb expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.961223:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074918.961225:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074918.961229:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8258 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296eb expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074918.961239:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074918.961328:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67165:x1855007616033408:12345-192.168.204.32@tcp:101:rm.0 Request processed in 587us (877us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074918.961336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9195 00000100:00100000:2.0:1769074918.966588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.966688:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033536 00000100:00100000:3.0:1769074918.966712:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033536 00000100:00100000:3.0:1769074918.966793:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 105 00000100:00100000:3.0:1769074918.966805:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2417:x1855007616033536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074918.966860:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.966897:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe826d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296f2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.966977:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074918.966996:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967009:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967025:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074918.967033:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967039:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967105:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967112:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967118:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967125:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.967130:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967137:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967150:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.967154:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.967159:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967165:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe8274 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967180:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967185:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967190:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967196:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074918.967199:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967204:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967210:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074918.967213:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074918.967216:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967222:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe827b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074918.967266:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe826d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296f2 expref: 370 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.967278:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074918.967280:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074918.967284:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe826d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296f2 expref: 370 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.967294:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a800, rc -2) 00000100:00100000:3.0:1769074918.967395:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2417:x1855007616033536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 591us (822us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074918.967403:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 105 00000100:00100000:0.0:1769074918.971803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074918.971926:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033664 00000100:00100000:1.0:1769074918.971940:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033664 00000100:00100000:1.0:1769074918.972024:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9196 00000100:00100000:1.0:1769074918.972035:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67165:x1855007616033664:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074918.972063:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074918.972094:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8282 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e296f9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.972179:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.972197:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972211:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972226:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074918.972233:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972239:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972318:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972325:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972331:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972337:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.972342:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972350:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972364:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.972368:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.972374:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972379:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8289 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972395:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972400:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972405:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972409:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074918.972412:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972416:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972423:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff916052b4c200) 00010000:00010000:1.0:1769074918.972425:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.972427:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972432:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8290 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074918.972470:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8282 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296f9 expref: 370 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.972481:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074918.972483:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074918.972486:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe8282 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e296f9 expref: 370 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074918.972505:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296c00, rc 0) 00000100:00100000:1.0:1769074918.972620:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67165:x1855007616033664:12345-192.168.204.32@tcp:101:rm.0 Request processed in 587us (835us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074918.972627:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9196 00000100:00100000:2.0:1769074918.998097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074918.998263:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033792 00000100:00100000:3.0:1769074918.998279:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033792 00000100:00100000:3.0:1769074918.998359:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9197 00000100:00100000:3.0:1769074918.998371:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67166:x1855007616033792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074918.998400:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074918.998439:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8297 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29700 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074918.998837:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074918.998857:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074918.999108:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.999946:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074918.999964:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074918.999974:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000045:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000053:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000061:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000068:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000074:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.000079:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000088:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000104:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.000108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.000113:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000120:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe829e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000139:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000146:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000151:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000157:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.000160:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000170:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000177:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff9161748d2600) 00010000:00010000:2.0:1769074919.000179:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.000182:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe82a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.000243:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8297 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29700 expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.000265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.000268:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.000272:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8297 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29700 expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.000283:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:2.0:1769074919.000477:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67166:x1855007616033792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2106us (2393us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.000489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9197 00000100:00100000:3.0:1769074919.007489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.008007:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616033920 00000100:00100000:2.0:1769074919.008024:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616033920 00000100:00100000:2.0:1769074919.008117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9198 00000100:00100000:2.0:1769074919.008129:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67166:x1855007616033920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.008156:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.008186:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe82ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29707 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.008291:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.008312:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008326:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008348:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.008356:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008362:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008454:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008462:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008469:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008476:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008483:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.008487:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008511:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008527:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.008569:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.008576:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008583:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe82b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008600:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008606:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008612:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008617:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.008620:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008626:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008634:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff9161748d2900) 00010000:00010000:2.0:1769074919.008636:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.008639:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008644:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe82ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.008686:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe82ac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29707 expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.008696:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.008711:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.008715:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe82ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29707 expref: 370 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.008726:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc 0) 00000100:00100000:2.0:1769074919.008803:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67166:x1855007616033920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 676us (1331us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.008812:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9198 00000100:00080000:0.0:1769074919.010127:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1769074919.014875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.015244:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034176 00000100:00100000:1.0:1769074919.015268:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034176 00000100:00100000:1.0:1769074919.015384:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9199 00000100:00100000:1.0:1769074919.015398:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67166:x1855007616034176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074919.015436:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.015466:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe82c1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2970e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.015667:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074919.015686:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.015711:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.015729:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074919.015741:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.015748:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074919.016421:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa3:0x0], index 1: 0 00010000:00010000:1.0:1769074919.017088:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe82d6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074919.017104:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe82d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017113:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe82d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017153:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017160:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017167:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017173:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.017178:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017185:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017199:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.017202:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.017208:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017214:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82c8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074919.017230:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000719ae8e3 reply state 00000000b2082a0e transno 4294968954 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017241:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.017247:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff916052b4c200) 00010000:00010000:1.0:1769074919.017250:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074919.017264:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074919.017310:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296c00/0x557988ac98fe82c1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2970e expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.017326:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296a00/0x557988ac98fe82d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2970e expref: 371 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.017334:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14f:0x0].0x0 (ffff916052b4c300) 00010000:00010000:1.0:1769074919.017336:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074919.017339:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296a00, rc 0) 00000100:00100000:1.0:1769074919.018040:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67166:x1855007616034176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2639us (3504us total) trans 4294968954 rc 0/0 00000100:00100000:1.0:1769074919.018051:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9199 00000100:00100000:3.0:1769074919.021764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.021883:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034304 00000100:00100000:0.0:1769074919.021896:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034304 00000100:00100000:0.0:1769074919.021992:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2641 00000100:00100000:0.0:1769074919.022006:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+140:2419:x1855007616034304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.022032:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.022063:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29715 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074919.022096:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074919.022121:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.022124:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.022134:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 141 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.022154:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 141 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.022167:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc 0) 00000100:00100000:0.0:1769074919.022247:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2419:x1855007616034304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 245us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.022265:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2641 00000100:00080000:2.0:1769074919.022811:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074919.026199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.026389:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034432 00000100:00100000:1.0:1769074919.026402:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034432 00000100:00100000:1.0:1769074919.026490:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2642 00000100:00100000:1.0:1769074919.026501:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:67166:x1855007616034432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074919.026572:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.026599:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2971c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.026639:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074919.026649:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.026651:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.026655:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2971c expref: 142 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.026696:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074919.026713:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:1.0:1769074919.026729:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626611072:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074919.026875:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a300 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.029803:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626611072:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074919.029856:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2971c expref: 142 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.029896:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296c00, rc 0) 00000100:00100000:1.0:1769074919.029972:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:67166:x1855007616034432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3471us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074919.029983:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2642 00000100:00100000:3.0:1769074919.032756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.033079:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034560 00000100:00100000:1.0:1769074919.033093:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034560 00010000:00010000:1.0:1769074919.033163:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:1.0:1769074919.033216:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1849 00000100:00100000:1.0:1769074919.033228:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2417:x1855007616034560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074919.033246:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074919.033283:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074919.033299:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074919.033331:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052b4b600/0x557988ac98fe82e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29715 expref: 142 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:1.0:1769074919.033351:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.033354:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.033362:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2971c expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.033372:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2971c expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.033436:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e296c00/0x557988ac98fe82eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2971c expref: 141 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074919.033453:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626611200:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074919.033864:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a300 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.037636:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626611200:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074919.037676:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074919.037752:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2417:x1855007616034560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4525us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074919.037765:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1849 00000100:00100000:0.0:1769074919.044100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.044208:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034816 00000100:00100000:2.0:1769074919.044222:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034816 00000100:00100000:2.0:1769074919.044304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1834 00000100:00100000:2.0:1769074919.044316:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67166:x1855007616034816:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074919.044783:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67166:x1855007616034816:12345-192.168.204.32@tcp:35:cp.0 Request processed in 468us (697us total) trans 4294968955 rc 0/0 00000100:00100000:2.0:1769074919.044793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1834 00000100:00100000:3.0:1769074919.086298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.086412:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616034944 00000100:00100000:1.0:1769074919.086427:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616034944 00000100:00100000:1.0:1769074919.086564:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9200 00000100:00100000:1.0:1769074919.086573:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67170:x1855007616034944:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074919.086597:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.086620:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29723 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.086726:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074919.086742:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086756:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086777:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074919.086784:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086790:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086878:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086887:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086894:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086900:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.086904:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086911:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086924:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.086927:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.086932:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086936:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe82f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086947:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086952:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086955:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086958:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.086959:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086962:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086965:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff916052b4c500) 00010000:00010000:1.0:1769074919.086967:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.086968:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.086971:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8300 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074919.087007:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82f2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29723 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.087014:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.087015:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.087017:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe82f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29723 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.087023:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297400, rc 0) 00000100:00100000:1.0:1769074919.087094:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67170:x1855007616034944:12345-192.168.204.32@tcp:101:bash.0 Request processed in 521us (807us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074919.087103:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9200 00000100:00080000:2.0:1769074919.087441:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074919.106032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.106102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.106261:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035072 00000100:00100000:1.0:1769074919.106277:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035072 00000100:00100000:1.0:1769074919.106347:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 106 00000100:00100000:1.0:1769074919.106358:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2417:x1855007616035072:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074919.106430:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.106457:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8307 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2972a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.106585:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074919.106603:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106617:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106634:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074919.106640:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106647:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106722:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106731:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106738:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106745:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.106750:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106758:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106774:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.106777:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.106783:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106789:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe830e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106806:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106811:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106817:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106822:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.106825:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106831:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106843:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff916052b4c500) 00010000:00010000:1.0:1769074919.106846:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.106849:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106854:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8315 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074919.106893:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8307 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2972a expref: 374 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.106911:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.106914:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074919.106918:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8307 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2972a expref: 374 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.106929:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297400, rc -2) 00000100:00100000:1.0:1769074919.107014:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2417:x1855007616035072:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 656us (909us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074919.107023:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 106 00000100:00100000:2.0:1769074919.108612:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035200 00000100:00100000:2.0:1769074919.108627:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035200 00000100:00100000:2.0:1769074919.108697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9201 00000100:00100000:2.0:1769074919.108707:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67171:x1855007616035200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074919.108730:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.108754:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe831c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29731 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.108831:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.108847:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108860:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108875:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.108882:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108888:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108951:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108959:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108966:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108972:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108979:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.108983:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.108991:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109002:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.109005:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.109010:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109017:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8323 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109032:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109037:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109043:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109047:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.109050:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109056:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109063:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff9161748d2900) 00010000:00010000:2.0:1769074919.109065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.109068:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109072:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe832a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.109106:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe831c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29731 expref: 374 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.109115:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.109118:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.109122:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe831c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29731 expref: 374 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.109130:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb000, rc 0) 00000100:00100000:2.0:1769074919.109208:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67171:x1855007616035200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 502us (3192us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.109216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9201 00000100:00100000:3.0:1769074919.114743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.115030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.115063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.115106:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035456 00000100:00100000:2.0:1769074919.115120:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035456 00000100:00100000:2.0:1769074919.115201:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 271 00000100:00100000:2.0:1769074919.115213:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604361b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616035456:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074919.115322:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604361b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616035456:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074919.115330:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 271 00000100:00100000:3.0:1769074919.120411:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.120561:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035584 00000100:00100000:1.0:1769074919.120575:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035584 00000100:00100000:1.0:1769074919.120697:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035712 00000100:00100000:1.0:1769074919.120701:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035712 00000100:00100000:3.0:1769074919.121296:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035328 00000100:00100000:3.0:1769074919.121302:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035328 00000100:00100000:3.0:1769074919.121351:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3134 00000100:00100000:3.0:1769074919.121364:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616035584:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1769074919.121475:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616035584:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 113us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.121484:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3134 00000100:00100000:3.0:1769074919.121520:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9202 00000100:00100000:3.0:1769074919.121558:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67171:x1855007616035328:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074919.121574:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.121601:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8331 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29738 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.121699:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074919.121719:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121732:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121749:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074919.121757:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121764:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121835:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121843:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121849:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.121855:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122098:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.122104:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122117:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122135:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.122138:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.122144:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122150:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe8338 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122169:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122175:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122181:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122185:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.122188:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122194:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122201:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074919.122203:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.122205:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122210:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe833f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074919.122264:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8331 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29738 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.122276:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.122278:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.122282:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8331 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29738 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.122291:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b000, rc 0) 00000100:00100000:3.0:1769074919.122330:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67171:x1855007616035328:12345-192.168.204.32@tcp:101:rm.0 Request processed in 802us (1935us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074919.122337:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9202 00000100:00080000:0.0:1769074919.123105:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769074919.128177:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3135 00000100:00100000:1.0:1769074919.128198:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616035712:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074919.128334:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616035712:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 142us (13268us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074919.128347:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3135 00000100:00100000:3.0:1769074919.145840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.146046:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035840 00000100:00100000:2.0:1769074919.146059:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035840 00000100:00100000:2.0:1769074919.146135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9203 00000100:00100000:2.0:1769074919.146145:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67172:x1855007616035840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.146172:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.146200:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8346 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2973f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.146304:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.146322:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146335:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146350:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.146357:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146362:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146446:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146454:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146461:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146468:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146474:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.146479:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146490:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146504:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.146508:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.146514:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146520:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe834d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146590:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146597:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146603:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146608:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.146611:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146616:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146623:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff9161748d2900) 00010000:00010000:2.0:1769074919.146626:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.146629:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146634:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8354 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.146677:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8346 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2973f expref: 374 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.146688:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.146691:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.146695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8346 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2973f expref: 374 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.146705:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074919.146786:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67172:x1855007616035840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 641us (961us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.146795:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9203 00000100:00100000:1.0:1769074919.155323:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.155441:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616035968 00000100:00100000:3.0:1769074919.155457:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616035968 00000100:00100000:3.0:1769074919.155590:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9204 00000100:00100000:3.0:1769074919.155603:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67172:x1855007616035968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.155632:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.155663:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe835b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29746 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.155757:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.155777:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.155791:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.155809:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.155817:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.155823:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156330:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156340:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156348:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156354:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.156359:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156367:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156382:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.156385:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.156391:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156397:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8362 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156420:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156426:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156431:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156436:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.156438:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156444:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156451:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074919.156454:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.156456:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156462:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8369 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.156672:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe835b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29746 expref: 374 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.156685:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.156687:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.156691:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6be00/0x557988ac98fe835b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29746 expref: 374 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.156702:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6be00, rc 0) 00000100:00100000:3.0:1769074919.156795:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67172:x1855007616035968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1194us (1485us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074919.156806:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9204 00000100:00100000:0.0:1769074919.162578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.162792:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036224 00000100:00100000:3.0:1769074919.162808:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036224 00000100:00100000:3.0:1769074919.162890:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9205 00000100:00100000:3.0:1769074919.162901:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67172:x1855007616036224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.162928:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.162956:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8370 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2974d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.163118:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.163137:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163151:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163169:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe9739016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.163176:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163182:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074919.163653:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa3:0x0], index 0: 0 00010000:00010000:3.0:1769074919.163840:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ac00/0x557988ac98fe8385 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x150:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.163852:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ac00/0x557988ac98fe8385 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163860:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ac00/0x557988ac98fe8385 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163900:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163907:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163913:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163920:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.163926:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163934:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163948:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.163951:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.163956:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163962:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe8377 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074919.163977:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e7fc0194 reply state 000000004c6e8082 transno 4294968956 ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163989:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.163995:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074919.163999:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074919.164002:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074919.164040:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8370 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2974d expref: 376 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.164055:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ac00/0x557988ac98fe8385 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x150:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2974d expref: 375 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.164063:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x150:0x0].0x0 (ffff91604ecb7000) 00010000:00010000:3.0:1769074919.164066:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074919.164069:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ac00, rc 0) 00000100:00100000:3.0:1769074919.164167:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67172:x1855007616036224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1266us (1644us total) trans 4294968956 rc 0/0 00000100:00100000:3.0:1769074919.164178:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9205 00000100:00100000:1.0:1769074919.168125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.168259:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036352 00000100:00100000:2.0:1769074919.168275:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036352 00000100:00100000:2.0:1769074919.168363:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2643 00000100:00100000:2.0:1769074919.168374:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2418:x1855007616036352:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.168397:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.168432:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29754 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074919.168459:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074919.168485:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074919.168487:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074919.168507:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 143 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074919.168526:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 143 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074919.168575:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074919.168646:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2418:x1855007616036352:12345-192.168.204.32@tcp:101:cp.0 Request processed in 274us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074919.168653:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2643 00000100:00080000:1.0:1769074919.169126:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074919.172961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.173063:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036480 00000100:00100000:3.0:1769074919.173080:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036480 00000100:00100000:3.0:1769074919.173153:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2644 00000100:00100000:3.0:1769074919.173164:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:67172:x1855007616036480:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.173189:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.173213:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2975b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.173283:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 144 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.173293:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.173296:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.173301:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2975b expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.173380:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 144 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.173395:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 144 pid: 8405 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.173422:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626611328:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074919.173589:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.177179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.177303:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036608 00000100:00100000:0.0:1769074919.177317:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036608 00010000:00010000:0.0:1769074919.177390:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 145 pid: 8405 timeout: 2008 lvb_type: 1 00000100:00100000:0.0:1769074919.177449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1850 00000100:00100000:0.0:1769074919.177460:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2420:x1855007616036608:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.177481:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.177742:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 145 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.177761:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 145 pid: 8405 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.177799:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.177802:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.177811:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2975b expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.177823:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2975b expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.177872:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2975b expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.177889:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626611456:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.178030:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1769074919.178139:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f499a00/0x557988ac98fe8393 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29754 expref: 145 pid: 8405 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.178158:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626611328:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074919.178192:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6be00/0x557988ac98fe839a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2975b expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.178204:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6be00, rc 0) 00000100:00100000:3.0:1769074919.178243:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:67172:x1855007616036480:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5081us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.178263:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2644 00000100:00100000:1.0:1769074919.182938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.183103:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036864 00000100:00100000:2.0:1769074919.183118:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036864 00000100:00100000:2.0:1769074919.183195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1835 00000100:00100000:2.0:1769074919.183207:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67172:x1855007616036864:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074919.183687:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67172:x1855007616036864:12345-192.168.204.32@tcp:35:cp.0 Request processed in 480us (761us total) trans 4294968957 rc 0/0 00000100:00100000:2.0:1769074919.183698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1835 00000100:00100000:0.0:1769074919.184737:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626611456:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.184777:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.184839:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2420:x1855007616036608:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7379us (7675us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.184849:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1850 00000100:00100000:1.0:1769074919.216682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.216817:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616036992 00000100:00100000:2.0:1769074919.216833:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616036992 00000100:00100000:2.0:1769074919.216921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9206 00000100:00100000:2.0:1769074919.216933:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67175:x1855007616036992:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074919.216962:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.216996:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29762 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.217090:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.217109:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217122:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217142:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.217149:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217155:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217228:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217236:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217242:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217260:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217267:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.217273:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217281:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217294:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.217298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.217304:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217310:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217329:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217334:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217339:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217344:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.217347:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217353:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217360:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9161748d2500) 00010000:00010000:2.0:1769074919.217363:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.217366:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217372:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.217412:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29762 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.217423:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.217425:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.217429:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29762 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.217443:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074919.217526:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67175:x1855007616036992:12345-192.168.204.32@tcp:101:bash.0 Request processed in 595us (858us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.217607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9206 00000100:00100000:1.0:1769074919.229280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.229578:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037120 00000100:00100000:3.0:1769074919.229594:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037120 00000100:00100000:3.0:1769074919.229677:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9207 00000100:00100000:3.0:1769074919.229688:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67176:x1855007616037120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074919.229722:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.229754:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29769 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.229846:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.230059:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230075:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230092:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074919.230099:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230104:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230179:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230187:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230193:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230199:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.230204:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230211:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230227:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.230232:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.230237:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230244:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230269:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230275:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230281:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230287:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.230289:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230295:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230303:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff91604ecb7500) 00010000:00010000:3.0:1769074919.230306:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.230308:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230314:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.230356:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83b6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29769 expref: 378 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.230368:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.230371:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.230375:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29769 expref: 378 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.230384:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc 0) 00000100:00100000:3.0:1769074919.230522:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67176:x1855007616037120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 834us (1255us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074919.230577:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9207 00000100:00100000:1.0:1769074919.235180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.235226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.235346:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037376 00000100:00100000:2.0:1769074919.235360:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037376 00000100:00100000:2.0:1769074919.235444:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9208 00000100:00100000:2.0:1769074919.235455:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67176:x1855007616037376:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074919.235482:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.235519:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29777 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.235639:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.235659:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235671:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235686:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.235693:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235699:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235771:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235779:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235787:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235793:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.235798:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235806:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235821:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.235824:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.235829:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235836:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe83d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235849:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235854:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235865:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235870:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.235874:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235880:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235886:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9161748d2500) 00010000:00010000:2.0:1769074919.235888:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.235891:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235896:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe83d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.235931:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83cb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29777 expref: 378 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.235940:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.235942:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.235945:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe83cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29777 expref: 378 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.235953:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074919.236019:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67176:x1855007616037376:12345-192.168.204.32@tcp:101:rm.0 Request processed in 566us (791us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.236027:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9208 00000100:00100000:3.0:1769074919.237302:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037248 00000100:00100000:3.0:1769074919.237317:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037248 00000100:00100000:3.0:1769074919.237443:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 107 00000100:00100000:3.0:1769074919.237454:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616037248:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074919.237518:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.237569:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29770 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.237638:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074919.237653:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237665:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237680:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074919.237690:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237696:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237755:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237763:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237770:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237777:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.237782:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237790:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237803:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.237806:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.237810:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237816:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe83e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237827:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237833:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237840:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237845:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.237848:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.237853:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.238235:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff91604ecb7500) 00010000:00010000:3.0:1769074919.238238:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.238241:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.238247:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b000/0x557988ac98fe83ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.238294:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83e0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29770 expref: 378 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.238304:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.238306:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074919.238310:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe83e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29770 expref: 378 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.238319:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc -2) 00000100:00100000:3.0:1769074919.238607:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616037248:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1153us (3439us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074919.238617:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 107 00000100:00100000:1.0:1769074919.263858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.263984:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037504 00000100:00100000:0.0:1769074919.264000:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037504 00000100:00100000:0.0:1769074919.264081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9209 00000100:00100000:0.0:1769074919.264092:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67177:x1855007616037504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.264120:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.264148:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe83f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2977e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.264286:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.264304:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264315:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264332:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.264338:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264355:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264430:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264439:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264446:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264453:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264459:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.264464:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264476:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264693:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.264699:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.264706:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264713:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe83fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264730:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264737:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264743:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264747:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.264751:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264757:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264765:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9160448a0200) 00010000:00010000:0.0:1769074919.264767:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.264770:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264775:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8403 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.264813:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe83f5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2977e expref: 378 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.264825:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.264828:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.264832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe83f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2977e expref: 378 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.264841:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:0.0:1769074919.264926:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67177:x1855007616037504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 835us (1085us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.264934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9209 00000100:00100000:1.0:1769074919.280307:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.280682:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037632 00000100:00100000:0.0:1769074919.280697:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037632 00000100:00100000:0.0:1769074919.280773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9210 00000100:00100000:0.0:1769074919.280786:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67177:x1855007616037632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.280815:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.280845:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe840a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29785 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.280951:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.280969:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.280983:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281005:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.281012:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281019:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281093:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281101:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281108:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281115:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281122:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.281127:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281135:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281149:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.281153:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.281159:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281164:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe8411 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281182:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281188:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281193:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281199:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.281201:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281207:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281213:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9160448a0200) 00010000:00010000:0.0:1769074919.281216:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.281218:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281223:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8418 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.281272:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe840a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29785 expref: 378 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.281283:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.281285:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.281288:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe840a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29785 expref: 378 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.281302:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:0.0:1769074919.282340:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67177:x1855007616037632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1545us (2039us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.282364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9210 00000100:00100000:2.0:1769074919.292362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.292480:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616037888 00000100:00100000:0.0:1769074919.292507:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616037888 00000100:00100000:0.0:1769074919.292624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9211 00000100:00100000:0.0:1769074919.292645:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67177:x1855007616037888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.292674:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.292702:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe841f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2978c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.292876:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.292896:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.292908:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.292925:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3daa257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.292931:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.292936:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074919.293467:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa4:0x0], index 1: 0 00010000:00010000:0.0:1769074919.293716:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8434 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x151:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.293730:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8434 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293738:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8434 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293784:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293792:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293799:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293805:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293812:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.293817:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293824:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293838:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.293842:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.293848:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293873:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8426 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074919.293891:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e093739 reply state 000000000a01f745 transno 4294968958 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293904:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.293910:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9160448a0200) 00010000:00010000:0.0:1769074919.293912:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074919.293916:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074919.293954:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe841f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2978c expref: 380 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.293972:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1b5400/0x557988ac98fe8434 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x151:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2978c expref: 379 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.293981:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x151:0x0].0x0 (ffff9160448a0e00) 00010000:00010000:0.0:1769074919.293983:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074919.293986:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1b5400, rc 0) 00000100:00100000:0.0:1769074919.294075:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67177:x1855007616037888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1441us (1740us total) trans 4294968958 rc 0/0 00000100:00100000:0.0:1769074919.294085:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9211 00000100:00100000:2.0:1769074919.300060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.300642:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038016 00000100:00100000:3.0:1769074919.300658:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038016 00000100:00100000:3.0:1769074919.300748:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2645 00000100:00100000:3.0:1769074919.300761:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+141:2420:x1855007616038016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.300787:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.300816:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29793 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074919.300848:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074919.301107:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.301111:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.301123:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.301146:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 142 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.301164:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc 0) 00000100:00100000:3.0:1769074919.301263:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2420:x1855007616038016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 504us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.301272:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2645 00000100:00100000:1.0:1769074919.310689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.311623:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038144 00000100:00100000:3.0:1769074919.311642:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038144 00000100:00100000:3.0:1769074919.311726:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2646 00000100:00100000:3.0:1769074919.311739:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:67177:x1855007616038144:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.311765:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.311791:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2979a expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.312176:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.312187:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.312189:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.312194:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2979a expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.312243:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.312271:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 143 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.312289:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626611584:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074919.312759:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1769074919.318766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.319245:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038272 00000100:00100000:0.0:1769074919.319271:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038272 00010000:00010000:0.0:1769074919.319364:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:0.0:1769074919.319438:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1851 00000100:00100000:0.0:1769074919.319449:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2420:x1855007616038272:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.319471:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.319500:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.319517:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.319605:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.319608:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.319618:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2979a expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.319628:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2979a expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.319676:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2979a expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.319694:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626611712:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.320678:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5840 going to sleep for 11 seconds 00010000:00010000:3.0:1769074919.320823:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a400/0x557988ac98fe8442 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29793 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.320842:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626611584:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074919.320891:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6b000/0x557988ac98fe8449 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2979a expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.320905:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b000, rc 0) 00000100:00100000:3.0:1769074919.320946:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:67177:x1855007616038144:12345-192.168.204.32@tcp:101:cp.0 Request processed in 9210us (10274us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.320957:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2646 00000100:00100000:0.0:1769074919.324921:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626611712:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.324965:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.325074:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2420:x1855007616038272:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5625us (6325us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.325088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1851 00000100:00100000:1.0:1769074919.326779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.326956:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038528 00000100:00100000:3.0:1769074919.326969:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038528 00000100:00100000:3.0:1769074919.327041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1836 00000100:00100000:3.0:1769074919.327053:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67177:x1855007616038528:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074919.327501:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67177:x1855007616038528:12345-192.168.204.32@tcp:35:cp.0 Request processed in 449us (732us total) trans 4294968959 rc 0/0 00000100:00100000:3.0:1769074919.327511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1836 00000100:00100000:0.0:1769074919.348235:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626611840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1769074919.348860:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074919.349211:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626611840 00000100:00100000:1.0:1769074919.349223:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626611840 00000100:00100000:1.0:1769074919.349324:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1769074919.349335:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1855007626611840:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1769074919.349636:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1769074919.350902:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484937536 pending 0 free 3764449280 avail 3532926976 00000100:00100000:1.0:1769074919.351040:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1855007626611840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1702us (2689us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074919.351052:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1769074919.351681:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626611840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769074919.377173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.377966:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038656 00000100:00100000:3.0:1769074919.377984:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038656 00000100:00100000:3.0:1769074919.378067:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:3.0:1769074919.378080:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616038656:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074919.378141:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.378168:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8450 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297a1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.378259:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074919.378278:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378293:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378310:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074919.378317:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378323:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378393:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378401:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378408:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378416:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.378421:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378429:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378444:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.378448:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.378453:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378460:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8457 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378478:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378484:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378489:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378495:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.378498:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378504:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378510:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff91604ecb7400) 00010000:00010000:3.0:1769074919.378512:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.378515:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378521:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a000/0x557988ac98fe845e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074919.378629:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8450 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297a1 expref: 382 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.378640:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.378642:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074919.378646:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8450 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297a1 expref: 382 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.378655:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc -2) 00000100:00100000:3.0:1769074919.378756:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616038656:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 679us (1600us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074919.378767:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:1.0:1769074919.386205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.386331:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038784 00000100:00100000:2.0:1769074919.386626:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038784 00000100:00100000:2.0:1769074919.386697:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9212 00000100:00100000:2.0:1769074919.386721:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67180:x1855007616038784:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074919.386754:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.386782:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8465 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297a8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.387168:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.387187:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387200:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387216:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.387223:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387230:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387309:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387318:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387325:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.387335:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.387340:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388219:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388240:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.388244:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.388260:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388268:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe846c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388288:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388294:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388300:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388306:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.388309:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388314:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388321:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff9161748d2500) 00010000:00010000:2.0:1769074919.388323:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.388326:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.388330:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8473 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.390089:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8465 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297a8 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.390116:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.390120:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.390127:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8465 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297a8 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.390144:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074919.390269:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67180:x1855007616038784:12345-192.168.204.32@tcp:101:bash.0 Request processed in 3549us (4076us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.390280:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9212 00000100:00100000:2.0:1769074919.403388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.403448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.403590:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039040 00000100:00100000:0.0:1769074919.403602:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039040 00000100:00100000:0.0:1769074919.403668:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00100000:0.0:1769074919.403677:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2419:x1855007616039040:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074919.403720:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.403748:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe847a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297b6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.403826:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074919.403844:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403866:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403881:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074919.403886:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403891:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403948:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403953:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403958:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403962:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.403965:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403970:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403979:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.403982:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.403986:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.403991:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8481 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404002:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404005:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404009:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404012:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ede00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.404015:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404018:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404023:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604ea4d600) 00010000:00010000:0.0:1769074919.404025:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.404026:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404029:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe8488 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074919.404053:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe847a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297b6 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.404060:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.404061:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074919.404064:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe847a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297b6 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.404072:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc -2) 00000100:00100000:0.0:1769074919.404157:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2419:x1855007616039040:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 479us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074919.404165:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00100000:3.0:1769074919.405666:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616038912 00000100:00100000:3.0:1769074919.405683:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616038912 00000100:00100000:0.0:1769074919.405820:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9213 00000100:00100000:0.0:1769074919.405831:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67181:x1855007616038912:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.405852:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.405886:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe848f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297af expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.405964:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.405980:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.405991:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406006:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.406013:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406020:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406075:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406082:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406089:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406094:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.406099:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406107:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406125:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.406129:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.406134:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406139:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe8496 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406148:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406151:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406155:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406158:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.406160:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406163:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406167:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff91604ea4d500) 00010000:00010000:0.0:1769074919.406168:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.406169:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406172:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe849d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.406197:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe848f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297af expref: 382 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.406204:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.406206:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.406208:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe848f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297af expref: 382 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.406214:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed400, rc 0) 00000100:00100000:0.0:1769074919.406363:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67181:x1855007616038912:12345-192.168.204.32@tcp:101:rm.0 Request processed in 531us (2912us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.406371:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9213 00000100:00100000:1.0:1769074919.414452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.414971:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039168 00000100:00100000:2.0:1769074919.414985:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039168 00000100:00100000:2.0:1769074919.415072:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9214 00000100:00100000:2.0:1769074919.415086:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67181:x1855007616039168:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074919.415119:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.415145:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84a4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.415264:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.415283:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415296:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415313:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.415318:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415322:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415397:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415405:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415411:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415418:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415424:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.415429:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415437:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415455:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.415459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.415465:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415471:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415488:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415494:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415500:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415505:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.415507:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415513:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415520:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff9161748d2500) 00010000:00010000:2.0:1769074919.415522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.415524:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415573:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.415611:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84a4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297bd expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.415622:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.415624:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.415628:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297bd expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.415637:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074919.415724:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67181:x1855007616039168:12345-192.168.204.32@tcp:101:rm.0 Request processed in 640us (1289us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.415732:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9214 00000100:00100000:1.0:1769074919.436242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.436379:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039296 00000100:00100000:2.0:1769074919.436391:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039296 00000100:00100000:2.0:1769074919.436521:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9215 00000100:00100000:2.0:1769074919.436576:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67182:x1855007616039296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.436604:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.436634:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84b9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297c4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.436734:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.436749:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436760:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436771:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.436780:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436790:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436853:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436860:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436867:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436873:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436880:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.436885:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436893:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436907:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.436911:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.436918:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436923:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe84c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436935:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436940:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436943:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436946:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.436948:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436950:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436954:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff9161748d2500) 00010000:00010000:2.0:1769074919.436956:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.436957:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436960:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe84c7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.436989:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84b9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297c4 expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.436997:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.436998:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.437001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe84b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297c4 expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.437007:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074919.437074:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67182:x1855007616039296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 544us (854us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.437082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9215 00000100:00100000:1.0:1769074919.440058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.440121:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039424 00000100:00100000:2.0:1769074919.440135:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039424 00000100:00100000:2.0:1769074919.440209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9216 00000100:00100000:2.0:1769074919.440219:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67182:x1855007616039424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.440368:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.440395:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe84ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297cb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.440486:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.440513:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440571:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440589:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.440596:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440603:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440669:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440677:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440684:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440691:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440698:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.440702:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440720:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440734:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.440737:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.440743:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440749:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe84d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440764:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440769:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440775:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440780:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.440793:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440805:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440813:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff9161748d2300) 00010000:00010000:2.0:1769074919.440815:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.440818:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440824:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe84dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.440864:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe84ce lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297cb expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.440874:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.440877:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.440881:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe84ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297cb expref: 382 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.440892:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc 0) 00000100:00100000:2.0:1769074919.440971:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67182:x1855007616039424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 751us (925us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.440979:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9216 00000100:00100000:1.0:1769074919.444338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.444967:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039680 00000100:00100000:0.0:1769074919.444984:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039680 00000100:00100000:0.0:1769074919.445088:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9217 00000100:00100000:0.0:1769074919.445096:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67182:x1855007616039680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.445121:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.445144:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe84e3 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297d2 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.445300:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.445318:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.445331:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.445348:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xff149435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.445371:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.445377:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074919.445837:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa4:0x0], index 0: 0 00010000:00010000:0.0:1769074919.446018:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe84f8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x152:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.446028:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe84f8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x152:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446035:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe84f8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x152:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446075:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446083:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446090:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446096:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.446101:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446110:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446125:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.446130:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.446135:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446141:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe84ea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074919.446157:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000667572 reply state 0000000070fc1da1 transno 4294968960 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446169:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.446175:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff91604ea4d500) 00010000:00010000:0.0:1769074919.446178:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074919.446180:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074919.446221:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe84e3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d2 expref: 384 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.446238:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ede00/0x557988ac98fe84f8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x152:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d2 expref: 383 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.446259:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x152:0x0].0x0 (ffff91604ea4d600) 00010000:00010000:0.0:1769074919.446262:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074919.446265:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ede00, rc 0) 00000100:00100000:0.0:1769074919.446364:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67182:x1855007616039680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1267us (2040us total) trans 4294968960 rc 0/0 00000100:00100000:0.0:1769074919.446372:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9217 00000100:00100000:1.0:1769074919.450840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.450907:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039808 00000100:00100000:3.0:1769074919.450921:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039808 00000100:00100000:3.0:1769074919.451071:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2647 00000100:00100000:3.0:1769074919.451084:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2420:x1855007616039808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.451110:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.451148:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297d9 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074919.451176:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074919.451201:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.451204:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.451215:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.451255:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.451273:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc 0) 00000100:00100000:3.0:1769074919.451348:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2420:x1855007616039808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 266us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.451356:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2647 00000100:00100000:1.0:1769074919.457953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.458060:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616039936 00000100:00100000:3.0:1769074919.458075:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616039936 00000100:00100000:3.0:1769074919.458203:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2648 00000100:00100000:3.0:1769074919.458213:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:67182:x1855007616039936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.458244:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.458278:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297e0 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.458320:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.458334:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.458336:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.458341:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e0 expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.458388:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.458406:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.458422:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626611968:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074919.458620:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1769074919.461033:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626611968:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074919.461086:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e0 expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.461110:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a000, rc 0) 00000100:00100000:3.0:1769074919.461193:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:67182:x1855007616039936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2980us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.461203:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2648 00000100:00100000:1.0:1769074919.461637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.461867:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040064 00000100:00100000:0.0:1769074919.461877:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040064 00010000:00010000:0.0:1769074919.461940:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:0.0:1769074919.461974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1852 00000100:00100000:0.0:1769074919.461984:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2419:x1855007616040064:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.462002:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.462026:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.462039:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.462827:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fe8506 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297d9 expref: 145 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.462850:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.462852:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.462870:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e0 expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.462883:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e0 expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.462933:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6a000/0x557988ac98fe850d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e0 expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.462951:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626612096:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.464467:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5840 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.466854:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.466870:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626612096:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.466909:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.466994:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2419:x1855007616040064:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5009us (5357us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.467009:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1852 00000100:00100000:3.0:1769074919.467139:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040320 00000100:00100000:3.0:1769074919.467150:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040320 00000100:00100000:3.0:1769074919.467322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1837 00000100:00100000:3.0:1769074919.467333:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67182:x1855007616040320:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074919.467790:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67182:x1855007616040320:12345-192.168.204.32@tcp:35:cp.0 Request processed in 458us (950us total) trans 4294968961 rc 0/0 00000100:00100000:3.0:1769074919.467798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1837 00000100:00100000:1.0:1769074919.498140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.498319:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040448 00000100:00100000:0.0:1769074919.498332:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040448 00000100:00100000:0.0:1769074919.498471:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9218 00000100:00100000:0.0:1769074919.498482:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67185:x1855007616040448:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074919.498517:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.498596:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe8514 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297e7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.498681:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.498699:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498713:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498730:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.498737:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498743:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498828:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498837:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498844:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498851:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.498855:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498864:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498879:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.498882:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.498888:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498894:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe851b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498910:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498916:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498922:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498925:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.498927:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498934:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498939:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.498940:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.498942:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498946:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe8522 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.498974:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe8514 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.498982:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.498984:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.498986:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe8514 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297e7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.498993:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed400, rc 0) 00000100:00100000:0.0:1769074919.499060:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67185:x1855007616040448:12345-192.168.204.32@tcp:101:bash.0 Request processed in 580us (937us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.499069:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9218 00000100:00100000:2.0:1769074919.505833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.505924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.506022:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040704 00000100:00100000:3.0:1769074919.506035:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040704 00000100:00100000:3.0:1769074919.506112:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 110 00000100:00100000:3.0:1769074919.506124:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2417:x1855007616040704:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074919.506185:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.506210:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8529 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297f5 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.506299:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.506319:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506333:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506351:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.506358:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506365:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506437:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506445:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506452:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506458:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.506464:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506472:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506488:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.506509:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.506515:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506520:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8530 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506550:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506553:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506557:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506560:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.506563:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506567:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506572:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604e0be700) 00010000:00010000:3.0:1769074919.506573:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.506575:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506578:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b400/0x557988ac98fe8537 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.506606:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8529 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297f5 expref: 386 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.506614:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.506616:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074919.506620:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8529 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297f5 expref: 386 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.506629:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc -2) 00000100:00100000:3.0:1769074919.506716:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2417:x1855007616040704:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 593us (790us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074919.506725:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 110 00000100:00100000:0.0:1769074919.507177:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040576 00000100:00100000:0.0:1769074919.507185:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040576 00000100:00100000:0.0:1769074919.507284:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9219 00000100:00100000:0.0:1769074919.507294:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67186:x1855007616040576:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.507308:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.507325:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe853e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297ee expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.507377:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.507389:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507398:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507445:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.507453:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507461:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507522:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507555:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507562:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507568:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.507572:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507578:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507589:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.507592:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.507596:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507601:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe8545 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507612:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507617:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507622:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507628:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.507631:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507637:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507644:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff91604ea4d200) 00010000:00010000:0.0:1769074919.507646:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.507649:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507655:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe854c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.507682:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe853e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297ee expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.507691:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.507693:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.507696:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe853e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297ee expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.507705:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:0.0:1769074919.507761:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67186:x1855007616040576:12345-192.168.204.32@tcp:101:rm.0 Request processed in 468us (1946us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.507768:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9219 00000100:00100000:2.0:1769074919.510653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.510848:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040832 00000100:00100000:0.0:1769074919.510861:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040832 00000100:00100000:0.0:1769074919.510932:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9220 00000100:00100000:0.0:1769074919.510944:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67186:x1855007616040832:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.510972:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.510997:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8553 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e297fc expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.511080:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.511097:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511109:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511126:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.511137:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511144:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511209:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511216:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511223:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511230:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.511234:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511242:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511265:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.511269:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.511274:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511280:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe855a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511292:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511298:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511305:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511310:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.511313:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511319:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511326:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.511328:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.511331:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511337:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8561 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.511373:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8553 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297fc expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.511384:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.511387:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.511391:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8553 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e297fc expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.511399:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074919.511788:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67186:x1855007616040832:12345-192.168.204.32@tcp:101:rm.0 Request processed in 845us (1147us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.511797:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9220 00000100:00100000:1.0:1769074919.542316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.542583:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616040960 00000100:00100000:0.0:1769074919.542598:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616040960 00000100:00100000:0.0:1769074919.542688:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9221 00000100:00100000:0.0:1769074919.542701:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67187:x1855007616040960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.542727:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.542754:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8568 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29803 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.542876:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.542895:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.542909:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.542925:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.542932:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.542939:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543013:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543021:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543028:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543035:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.543040:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543793:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543812:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.543815:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.543822:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543829:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe856f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543849:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543854:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543861:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543866:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.543870:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543876:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543883:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.543886:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.543889:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543895:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8576 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.543940:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8568 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29803 expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.543952:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.543954:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.543958:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8568 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29803 expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.543967:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074919.544937:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67187:x1855007616040960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2231us (2630us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.544950:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9221 00000100:00100000:1.0:1769074919.549888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.550018:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041088 00000100:00100000:0.0:1769074919.550032:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041088 00000100:00100000:0.0:1769074919.550785:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9222 00000100:00100000:0.0:1769074919.550800:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67187:x1855007616041088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.550826:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.550853:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe857d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2980a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.550937:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.550955:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.550969:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.550986:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.550993:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.550999:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551503:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551512:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551519:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551525:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.551608:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551704:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551721:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.551724:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.551730:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551737:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8584 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551753:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551759:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551765:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551770:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.551773:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551778:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551784:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.551786:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.551788:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551793:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe858b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.551833:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe857d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2980a expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.551843:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.551845:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.551849:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe857d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2980a expref: 386 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.551864:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074919.551990:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67187:x1855007616041088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1193us (2116us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.552000:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9222 00000100:00100000:2.0:1769074919.560984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.561198:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041344 00000100:00100000:0.0:1769074919.561213:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041344 00000100:00100000:2.0:1769074919.561784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9223 00000100:00100000:2.0:1769074919.561799:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67187:x1855007616041344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.561831:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.561860:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe8592 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29811 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.562019:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.562038:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.562069:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.562087:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x9171a98b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.562095:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.562102:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074919.562972:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa5:0x0], index 1: 0 00010000:00010000:2.0:1769074919.563474:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe85a7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x153:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.563492:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe85a7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563503:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe85a7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563957:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563972:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563978:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563985:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.563992:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.563997:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.564006:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.564022:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.564025:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.564031:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.564037:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8599 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074919.564196:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000604f8f75 reply state 00000000bb0dda31 transno 4294968962 ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.564210:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.564217:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff9161748d2300) 00010000:00010000:2.0:1769074919.564379:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074919.564384:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074919.564434:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe8592 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29811 expref: 388 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.564453:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499c00/0x557988ac98fe85a7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x153:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29811 expref: 387 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.564461:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x153:0x0].0x0 (ffff9161748d2500) 00010000:00010000:2.0:1769074919.564463:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074919.564466:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499c00, rc 0) 00000100:00100000:2.0:1769074919.564922:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67187:x1855007616041344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3123us (3949us total) trans 4294968962 rc 0/0 00000100:00100000:2.0:1769074919.564934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9223 00000100:00100000:1.0:1769074919.574914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.575017:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041472 00000100:00100000:3.0:1769074919.575031:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041472 00000100:00100000:3.0:1769074919.575179:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2649 00000100:00100000:3.0:1769074919.575191:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+142:2420:x1855007616041472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.575231:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.575270:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29818 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074919.575300:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074919.575324:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.575327:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.575337:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.575358:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 143 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.575375:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:3.0:1769074919.575459:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2420:x1855007616041472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 270us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.575467:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2649 00000100:00100000:1.0:1769074919.579947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.580604:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041600 00000100:00100000:3.0:1769074919.580621:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041600 00000100:00100000:3.0:1769074919.580771:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2650 00000100:00100000:3.0:1769074919.580784:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:67187:x1855007616041600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074919.580810:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.580834:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2981f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.580874:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.580890:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.580893:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074919.580898:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2981f expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.580943:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074919.580961:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:3.0:1769074919.580979:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626612224:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074919.581135:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.585777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.585960:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626612224:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074919.586012:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2981f expref: 144 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.586040:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b400, rc 0) 00000100:00100000:3.0:1769074919.586129:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:67187:x1855007616041600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5346us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.586140:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2650 00000100:00100000:0.0:1769074919.587925:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041728 00000100:00100000:0.0:1769074919.587942:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041728 00010000:00010000:0.0:1769074919.588022:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00000100:00100000:0.0:1769074919.588229:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1853 00000100:00100000:0.0:1769074919.588238:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2419:x1855007616041728:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.588266:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.588293:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.588310:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.588346:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a200/0x557988ac98fe85b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29818 expref: 144 pid: 25313 timeout: 2008 lvb_type: 1 00010000:00010000:0.0:1769074919.588367:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.588369:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.588376:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2981f expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.588385:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2981f expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.588724:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6b400/0x557988ac98fe85bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2981f expref: 143 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.588741:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626612352:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.588860:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5840 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.593212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.593373:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626612352:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.593415:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.593492:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916180fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2419:x1855007616041728:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5253us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.593505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1853 00000100:00100000:3.0:1769074919.593916:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616041984 00000100:00100000:3.0:1769074919.593927:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616041984 00000100:00100000:3.0:1769074919.593985:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1838 00000100:00100000:3.0:1769074919.593995:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67187:x1855007616041984:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074919.594349:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67187:x1855007616041984:12345-192.168.204.32@tcp:35:cp.0 Request processed in 355us (1152us total) trans 4294968963 rc 0/0 00000100:00100000:3.0:1769074919.594357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1838 00010000:00010000:0.0:1769074919.607391:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074919.640974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.641196:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042112 00000100:00100000:1.0:1769074919.641211:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042112 00000100:00100000:1.0:1769074919.641299:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 111 00000100:00100000:1.0:1769074919.641313:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2420:x1855007616042112:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074919.641395:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.641430:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe85c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29826 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.641520:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074919.641582:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641598:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641617:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074919.641625:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641632:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641717:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641725:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641732:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641738:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.641743:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641750:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641764:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.641768:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.641774:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641780:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe85ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641797:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641802:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641808:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641813:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.641815:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641820:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641827:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff916052b4c500) 00010000:00010000:1.0:1769074919.641829:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.641832:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641837:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe85d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.641874:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe85c3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29826 expref: 390 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.641884:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.641886:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074919.641890:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe85c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29826 expref: 390 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.641900:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297800, rc -2) 00000100:00100000:1.0:1769074919.641998:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2420:x1855007616042112:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 687us (1041us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074919.642008:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 111 00000100:00100000:2.0:1769074919.673085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.673207:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042240 00000100:00100000:0.0:1769074919.673232:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042240 00000100:00100000:0.0:1769074919.673323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9224 00000100:00100000:0.0:1769074919.673336:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614858dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67193:x1855007616042240:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074919.673365:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.673393:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe85d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2985e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.673510:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.673575:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673593:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673610:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.673617:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673623:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673695:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673703:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673710:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673715:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673721:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.673726:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673734:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673748:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.673752:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.673757:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673764:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe85df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673779:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673784:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673790:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673795:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.673798:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673804:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673811:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.673814:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.673817:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673823:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe85e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.673858:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe85d8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2985e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.673869:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.673872:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.673876:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe85d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2985e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.673885:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074919.673958:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614858dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67193:x1855007616042240:12345-192.168.204.32@tcp:101:bash.0 Request processed in 624us (888us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.673967:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9224 00000100:00100000:2.0:1769074919.686879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.686939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.687041:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042496 00000100:00100000:3.0:1769074919.687058:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042496 00000100:00100000:3.0:1769074919.687139:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:3.0:1769074919.687153:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2419:x1855007616042496:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074919.687205:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.687234:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe85ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2986c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.687326:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.687343:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687357:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687374:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.687381:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687388:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687470:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687484:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687834:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687843:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.687848:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687857:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687872:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.687875:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.687881:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687887:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe85f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687903:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687909:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687916:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687921:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.687923:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687934:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687941:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604e0bed00) 00010000:00010000:3.0:1769074919.687944:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.687946:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687952:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe85fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.687988:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe85ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2986c expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.687999:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.688001:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074919.688005:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe85ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2986c expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.688015:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc -2) 00000100:00100000:2.0:1769074919.688301:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2419:x1855007616042496:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1149us (1359us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074919.688312:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:0.0:1769074919.689371:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042368 00000100:00100000:0.0:1769074919.689384:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042368 00000100:00100000:0.0:1769074919.689439:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9225 00000100:00100000:0.0:1769074919.689446:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67194:x1855007616042368:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.689464:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.689482:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8602 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29865 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.689756:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.689774:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689785:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689800:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.689806:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689813:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689886:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689894:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689901:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689907:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.689912:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689920:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689932:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.689934:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.689938:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689943:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8609 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689952:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689955:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689958:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689961:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.689964:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689968:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689971:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff91604ea4de00) 00010000:00010000:0.0:1769074919.689973:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.689974:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.689977:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8610 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.690003:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8602 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29865 expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.690009:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.690010:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.690012:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8602 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29865 expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.690017:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074919.690082:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67194:x1855007616042368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 636us (3230us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.690089:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9225 00000100:00100000:2.0:1769074919.697144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.697226:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042624 00000100:00100000:0.0:1769074919.697252:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042624 00000100:00100000:0.0:1769074919.697335:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9226 00000100:00100000:0.0:1769074919.697344:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67194:x1855007616042624:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.697370:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.697392:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8617 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29873 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.697474:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.697488:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697498:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697509:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074919.697514:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697518:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697602:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697607:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697611:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697615:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697619:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.697623:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697629:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697640:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.697642:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.697645:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe861e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697661:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697665:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697668:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697671:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.697672:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697675:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697678:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff91604ea4d200) 00010000:00010000:0.0:1769074919.697680:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.697681:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697687:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14a00/0x557988ac98fe8625 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074919.697717:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8617 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29873 expref: 390 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.697727:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.697729:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.697732:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8617 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29873 expref: 390 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.697742:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.697812:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67194:x1855007616042624:12345-192.168.204.32@tcp:101:rm.0 Request processed in 468us (679us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.697821:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9226 00000100:00100000:1.0:1769074919.722381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.722861:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042752 00000100:00100000:2.0:1769074919.722877:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042752 00000100:00100000:2.0:1769074919.722964:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9227 00000100:00100000:2.0:1769074919.722977:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67195:x1855007616042752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.723006:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.723036:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe862c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2987a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.723153:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.723172:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723187:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723205:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.723212:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723218:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723300:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723308:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723315:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723322:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.723326:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723334:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723351:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.723354:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.723360:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723365:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8633 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723382:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723387:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723393:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723398:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.723401:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723406:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723413:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff9161748d2000) 00010000:00010000:2.0:1769074919.723416:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.723419:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723424:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe863a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.723463:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe862c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2987a expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.723475:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.723477:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.723481:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe862c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2987a expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.724044:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074919.724216:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67195:x1855007616042752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1238us (1849us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.724226:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9227 00000100:00100000:1.0:1769074919.731812:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.731940:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616042880 00000100:00100000:2.0:1769074919.731954:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616042880 00000100:00100000:2.0:1769074919.732033:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9228 00000100:00100000:2.0:1769074919.732045:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67195:x1855007616042880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.732072:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.732099:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8641 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29881 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.732198:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.732215:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732228:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732253:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.732264:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732270:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732337:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732346:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732353:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732360:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.732365:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732374:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732387:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.732391:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.732397:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732415:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8648 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732430:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732434:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732440:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732444:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.732447:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732452:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732459:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff9161748d2000) 00010000:00010000:2.0:1769074919.732461:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.732464:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732470:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe864f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.732520:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8641 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29881 expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.732929:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.732934:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.732940:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8641 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29881 expref: 390 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.732953:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074919.733037:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67195:x1855007616042880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 993us (1240us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.733046:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9228 00000100:00100000:1.0:1769074919.744923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.745648:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043136 00000100:00100000:2.0:1769074919.745665:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043136 00000100:00100000:2.0:1769074919.745871:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9229 00000100:00100000:2.0:1769074919.745883:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67195:x1855007616043136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074919.745913:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.745940:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8656 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29888 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.746109:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.746287:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.746303:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.746323:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb4959068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.746329:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.746336:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074919.748353:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa5:0x0], index 0: 0 00010000:00010000:2.0:1769074919.749968:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe866b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x154:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074919.750066:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe866b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750083:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe866b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750222:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750230:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750269:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750277:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.750281:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750290:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750304:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.750308:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.750314:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750320:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe865d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074919.750341:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007298aada reply state 000000005b28067d transno 4294968964 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750353:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074919.750359:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff9161748d2000) 00010000:00010000:2.0:1769074919.750379:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074919.750384:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074919.750482:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8656 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29888 expref: 392 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.750518:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb000/0x557988ac98fe866b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x154:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29888 expref: 391 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.750628:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x154:0x0].0x0 (ffff9161748d2f00) 00010000:00010000:2.0:1769074919.750630:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074919.750633:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb000, rc 0) 00000100:00100000:2.0:1769074919.750785:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67195:x1855007616043136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4904us (5877us total) trans 4294968964 rc 0/0 00000100:00100000:2.0:1769074919.750811:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9229 00000001:00080000:2.0:1769074919.762290:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968964 is committed 00010000:00010000:3.0:1769074919.762603:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762620:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762629:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762635:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.762640:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762649:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762671:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x25a697b1 (ffff916052a0cb00) 00010000:00010000:3.0:1769074919.762675:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.762681:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762687:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe6cd3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x25a697b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.762725:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762731:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762737:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762742:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.762745:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762750:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762758:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4b91a408 (ffff916052af8500) 00010000:00010000:3.0:1769074919.762760:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.762763:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762768:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fe6d97 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4b91a408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762938:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762945:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762951:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762956:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.762959:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762965:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762974:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfe8f7efb (ffff916052af8c00) 00010000:00010000:3.0:1769074919.762977:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.762980:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.762985:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fe6e5b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfe8f7efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763002:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763008:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763014:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763023:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763025:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763031:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763039:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8433e308 (ffff91604f17d600) 00010000:00010000:3.0:1769074919.763041:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763045:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763051:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fe6f0a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8433e308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763068:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763074:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763079:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763084:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763086:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763092:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763099:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdacd11be (ffff916052af8d00) 00010000:00010000:3.0:1769074919.763103:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763106:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763112:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fe6fb9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdacd11be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763329:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763337:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763343:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763348:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763351:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763357:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763365:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4d2e161b (ffff91604f8b3000) 00010000:00010000:3.0:1769074919.763367:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763370:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763376:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe7068 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4d2e161b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763397:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00000100:00100000:1.0:1769074919.763655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1769074919.763756:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763763:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763769:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763771:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763785:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763794:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd17db4c (ffff91604f17d400) 00010000:00010000:3.0:1769074919.763829:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763833:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763855:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe7117 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdd17db4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.763880:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763886:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763893:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763897:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763900:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763918:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763926:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3ee4d1be (ffff916052a0c700) 00010000:00010000:3.0:1769074919.763929:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763932:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763937:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499400/0x557988ac98fe71db lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3ee4d1be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.763955:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763960:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763965:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763970:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.763973:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763978:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763984:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1c41c425 (ffff916052af8000) 00010000:00010000:3.0:1769074919.763986:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.763988:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.763993:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe72b4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1c41c425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764007:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764014:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764020:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764025:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764027:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764032:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764039:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37f49953 (ffff91604f42aa00) 00010000:00010000:3.0:1769074919.764041:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764043:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764048:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe7378 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x37f49953 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764064:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764069:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764074:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764078:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764081:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764087:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764095:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xeaddc672 (ffff916174a68600) 00010000:00010000:3.0:1769074919.764097:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764101:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764106:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe7427 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xeaddc672 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764133:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764139:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764145:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764150:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764152:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764158:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764166:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7505fae (ffff916174a68a00) 00010000:00010000:3.0:1769074919.764169:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764172:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764177:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe74d6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7505fae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764193:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764199:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764204:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764208:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764211:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764217:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764224:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb98d164 (ffff916174a68900) 00010000:00010000:3.0:1769074919.764227:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764230:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764235:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe7585 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb98d164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764263:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764270:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764275:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764284:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764286:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764292:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764299:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc9cf38bf (ffff916174a68300) 00010000:00010000:3.0:1769074919.764302:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764304:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764309:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe7649 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc9cf38bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764324:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764330:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764336:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764341:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764344:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764349:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764355:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x689dba72 (ffff916052a0c300) 00010000:00010000:3.0:1769074919.764359:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764361:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764366:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe7722 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x689dba72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764419:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764427:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764433:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764437:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764440:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764446:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764454:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6f0d6dbc (ffff916052af8400) 00010000:00010000:3.0:1769074919.764457:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764459:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764465:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe77e6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6f0d6dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764482:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764488:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764495:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764500:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764502:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764508:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764514:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4ec68a1 (ffff916052a0c800) 00010000:00010000:3.0:1769074919.764516:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764518:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764523:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe7895 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4ec68a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764589:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764595:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764601:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764606:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764608:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764613:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764621:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x22a1db4f (ffff91604f42ab00) 00010000:00010000:3.0:1769074919.764623:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764625:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764630:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe7944 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x22a1db4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764644:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764649:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764655:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764660:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764662:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764668:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764673:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe2725ff1 (ffff916052a0c200) 00010000:00010000:3.0:1769074919.764675:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764678:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764683:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe79f3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe2725ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764695:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764701:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764706:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764710:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764713:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764718:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764724:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3de31cd (ffff91604ec78a00) 00010000:00010000:3.0:1769074919.764726:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764728:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764733:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe7aa2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3de31cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764746:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764751:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764756:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764760:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764763:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764770:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764777:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fa77733 (ffff9161500d2700) 00010000:00010000:3.0:1769074919.764778:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764781:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764787:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe7b51 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5fa77733 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.764830:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764852:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764870:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764876:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764879:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764885:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764892:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaf4cee59 (ffff91604e24c400) 00010000:00010000:3.0:1769074919.764894:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764897:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764901:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe7c00 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaf4cee59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.764919:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764925:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764930:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764935:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.764937:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764943:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764969:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87382141 (ffff91604ec78000) 00010000:00010000:3.0:1769074919.764971:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.764974:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.764998:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe7caf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x87382141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765039:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765046:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765053:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765083:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765087:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765111:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765120:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85af2885 (ffff91604e24c000) 00010000:00010000:3.0:1769074919.765132:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765136:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765140:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe7d73 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x85af2885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.765168:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765175:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765190:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765195:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765197:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765202:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765222:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdda882ac (ffff91604e24c700) 00010000:00010000:3.0:1769074919.765225:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765228:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765252:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe7e4c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdda882ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765284:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765291:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765297:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765302:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765317:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765323:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765351:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17737191 (ffff91604ec78600) 00010000:00010000:3.0:1769074919.765354:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765376:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765383:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe7f25 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x17737191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765414:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765442:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765449:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765471:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765474:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765479:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765509:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfd828f79 (ffff9161748d2100) 00010000:00010000:3.0:1769074919.765512:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765515:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765520:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe7ffe lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfd828f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.765605:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765612:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765627:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765632:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765635:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765650:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765658:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4985395f (ffff91604e401b00) 00010000:00010000:3.0:1769074919.765660:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765663:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765689:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe80c2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4985395f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765744:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765752:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765768:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765773:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765776:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765792:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765801:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24b9d6c5 (ffff916052b4c800) 00010000:00010000:3.0:1769074919.765815:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765819:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765825:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8171 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x24b9d6c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765855:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765862:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765883:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765887:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765890:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765895:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765903:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x294e10fd (ffff916052b4cf00) 00010000:00010000:3.0:1769074919.765922:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.765927:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765932:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8220 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x294e10fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765957:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765973:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765978:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.765982:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.765984:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.766001:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.766008:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdbd29392 (ffff916052b4c200) 00010000:00010000:3.0:1769074919.766010:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766013:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.766033:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe82cf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdbd29392 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074919.766069:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766089:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766097:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766102:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.766105:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766111:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766130:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe9739016 (ffff91604ecb7c00) 00010000:00010000:3.0:1769074919.766132:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766136:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766152:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe837e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe9739016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766185:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766191:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766208:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766214:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.766216:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766222:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766231:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3daa257d (ffff9160448a0200) 00010000:00010000:3.0:1769074919.766261:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766265:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766291:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe842d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3daa257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766323:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766340:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766346:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766365:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.766368:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766374:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766381:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xff149435 (ffff91604ea4d500) 00010000:00010000:3.0:1769074919.766399:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766402:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766419:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe84f1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xff149435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766478:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766485:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766513:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766518:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.766573:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766591:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766600:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9171a98b (ffff9161748d2300) 00010000:00010000:3.0:1769074919.766603:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766623:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766629:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe85a0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9171a98b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074919.766677:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766699:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766705:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766718:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.766721:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766728:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766735:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb4959068 (ffff9161748d2000) 00010000:00010000:3.0:1769074919.766757:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.766761:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074919.766780:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8664 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb4959068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000100:00100000:0.0:1769074919.768253:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043264 00000100:00100000:0.0:1769074919.768273:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043264 00000100:00100000:0.0:1769074919.768433:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2651 00000100:00100000:0.0:1769074919.768446:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2417:x1855007616043264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.768473:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.768500:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2988f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074919.768558:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074919.768587:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.768590:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.768601:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.768630:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.768646:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.768796:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2417:x1855007616043264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 350us (5144us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.768805:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2651 00000100:00100000:1.0:1769074919.774482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.774871:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043392 00000100:00100000:0.0:1769074919.774886:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043392 00000100:00100000:0.0:1769074919.774969:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2652 00000100:00100000:0.0:1769074919.774981:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:67195:x1855007616043392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.775007:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.775033:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29896 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.775077:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.775086:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.775089:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.775094:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29896 expref: 146 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.775154:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.775177:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074919.775197:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626612480:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074919.775356:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5780 going to sleep for 11 seconds 00000100:00100000:0.0:1769074919.782106:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626612480:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074919.782212:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29896 expref: 146 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.782254:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14a00, rc 0) 00000100:00100000:0.0:1769074919.783276:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:67195:x1855007616043392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 8291us (8806us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.783289:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2652 00000100:00100000:1.0:1769074919.785112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.785347:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043520 00000100:00100000:0.0:1769074919.785360:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043520 00010000:00010000:0.0:1769074919.785427:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074919.785474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1854 00000100:00100000:0.0:1769074919.785486:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2420:x1855007616043520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.785505:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.785551:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074919.785572:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074919.785600:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052b15c00/0x557988ac98fe8679 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2988f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074919.785618:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.785620:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.785628:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29896 expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.785639:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29896 expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.785685:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052b14a00/0x557988ac98fe8680 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29896 expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.785702:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626612608:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.785824:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5780 going to sleep for 11 seconds 00000100:00100000:0.0:1769074919.788824:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626612608:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.789281:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.789426:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2420:x1855007616043520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3941us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.789443:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1854 00000100:00100000:1.0:1769074919.795574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.795722:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043776 00000100:00100000:0.0:1769074919.795758:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043776 00000100:00100000:0.0:1769074919.795900:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1839 00000100:00100000:0.0:1769074919.795913:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+283:67195:x1855007616043776:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074919.796443:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67195:x1855007616043776:12345-192.168.204.32@tcp:35:cp.0 Request processed in 532us (922us total) trans 4294968965 rc 0/0 00000100:00100000:0.0:1769074919.796450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1839 00000100:00100000:1.0:1769074919.828617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.829566:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616043904 00000100:00100000:2.0:1769074919.829586:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616043904 00000100:00100000:2.0:1769074919.829670:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:2.0:1769074919.829682:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2419:x1855007616043904:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074919.829761:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.829798:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8687 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2989d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.829889:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074919.829908:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.829921:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.829943:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074919.829950:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.829956:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830029:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830036:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830044:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830051:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.830056:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830064:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830077:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.830080:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.830087:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830094:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe868e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830111:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.830117:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.831722:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.831730:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.831735:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.831743:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.831759:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff9161748d2e00) 00010000:00010000:2.0:1769074919.831763:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.831767:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.833999:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8695 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.834113:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8687 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2989d expref: 285 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.834653:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.834658:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074919.834667:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8687 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2989d expref: 285 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.834685:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada000, rc -2) 00000100:00100000:2.0:1769074919.834845:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2419:x1855007616043904:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 5163us (6242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074919.837255:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:2.0:1769074919.858127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.858256:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044032 00000100:00100000:0.0:1769074919.858270:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044032 00000100:00100000:0.0:1769074919.858356:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9230 00000100:00100000:0.0:1769074919.858367:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67200:x1855007616044032:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074919.858394:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.858723:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe869c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e298d5 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.858813:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.858832:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.858846:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859005:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.859014:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859020:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859097:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859105:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859112:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859118:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.859122:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859130:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859145:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.859148:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.859154:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859161:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859176:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859182:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859187:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859192:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.859196:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859201:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859209:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff91604ea4d100) 00010000:00010000:0.0:1769074919.859211:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.859214:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859220:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.859341:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe869c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298d5 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.859354:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.859356:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.859360:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe869c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298d5 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.859370:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.865012:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67200:x1855007616044032:12345-192.168.204.32@tcp:101:bash.0 Request processed in 6626us (6889us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.865031:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9230 00000001:00080000:2.0:1769074919.872297:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967854 is committed 00000001:00080000:3.0:1769074919.872632:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967843 is committed 00000100:00100000:1.0:1769074919.888167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.888223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.888324:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044160 00000100:00100000:0.0:1769074919.888340:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044160 00000100:00100000:0.0:1769074919.888436:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9231 00000100:00100000:0.0:1769074919.888449:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67201:x1855007616044160:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074919.888484:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.888514:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe86b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e298dc expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.888635:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.888654:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888667:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888683:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.888691:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888775:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888983:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888992:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.888999:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889006:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.889011:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889023:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889039:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.889042:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.889049:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889056:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe86b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889071:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889077:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889083:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889088:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.889091:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889097:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889104:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff91604ea4d100) 00010000:00010000:0.0:1769074919.889107:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.889110:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889116:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe86bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.889159:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe86b1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298dc expref: 285 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.889170:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.889173:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.889177:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe86b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298dc expref: 285 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.889187:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.889274:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67201:x1855007616044160:12345-192.168.204.32@tcp:101:rm.0 Request processed in 828us (1122us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.889283:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9231 00000100:00100000:3.0:1769074919.890075:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044288 00000100:00100000:3.0:1769074919.890086:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044288 00000100:00100000:3.0:1769074919.890131:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:3.0:1769074919.890141:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2417:x1855007616044288:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074919.890201:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074919.890218:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe86c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e298e3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.890281:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.890296:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890308:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890324:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074919.890330:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890337:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890388:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890395:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890414:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890419:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.890424:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890431:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890443:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.890446:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.890450:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890456:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe86cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890470:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890476:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890481:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890486:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074919.890490:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890495:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890503:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604e0bec00) 00010000:00010000:3.0:1769074919.890506:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074919.890509:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890518:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe86d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074919.890572:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe86c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298e3 expref: 285 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.890582:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074919.890584:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074919.890588:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe86c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e298e3 expref: 285 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074919.890596:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ba00, rc -2) 00000100:00100000:3.0:1769074919.890668:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2417:x1855007616044288:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 528us (2443us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074919.890677:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:1.0:1769074919.897207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.898081:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044416 00000100:00100000:2.0:1769074919.898098:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044416 00000100:00100000:2.0:1769074919.898190:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9232 00000100:00100000:2.0:1769074919.898203:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67201:x1855007616044416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074919.898233:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.898274:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe86db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2991b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.898369:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.898387:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898400:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898427:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074919.898434:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898440:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898664:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898678:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898684:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898690:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898771:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.898778:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898788:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898805:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.898808:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.898816:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898823:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe86e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.898841:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899000:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899009:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899015:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.899018:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899025:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899034:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff91604f4dfd00) 00010000:00010000:2.0:1769074919.899036:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.899039:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899045:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe86e9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074919.899092:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe86db lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2991b expref: 285 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.899103:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.899106:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.899110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe86db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2991b expref: 285 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.899120:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:2.0:1769074919.899349:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67201:x1855007616044416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1146us (2153us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074919.899359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9232 00000100:00100000:2.0:1769074919.916843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.917132:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044544 00000100:00100000:1.0:1769074919.917146:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044544 00000100:00100000:1.0:1769074919.917227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9233 00000100:00100000:1.0:1769074919.917269:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67204:x1855007616044544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074919.917297:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.917329:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe86f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.917420:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074919.917439:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917452:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917470:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074919.917482:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917488:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917604:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917612:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917618:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917624:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917630:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.917634:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917642:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917656:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.917659:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.917664:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917670:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe86f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917685:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917691:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917697:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917702:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.917705:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917710:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917716:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff916052b4c500) 00010000:00010000:1.0:1769074919.917718:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.917720:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917725:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe86fe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.917764:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe86f0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29922 expref: 285 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.917773:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.917775:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.917779:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe86f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29922 expref: 285 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.917788:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296200, rc 0) 00000100:00100000:1.0:1769074919.917865:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67204:x1855007616044544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 627us (1039us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074919.917874:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9233 00000100:00100000:3.0:1769074919.922817:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.923102:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044672 00000100:00100000:1.0:1769074919.923117:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044672 00000100:00100000:1.0:1769074919.923191:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:1.0:1769074919.923203:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2418:x1855007616044672:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074919.923289:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.923317:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8705 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29929 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.923409:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074919.923428:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923442:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923461:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074919.923469:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923474:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923583:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923592:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923600:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923606:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.923609:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923617:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923631:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.923635:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.923640:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923646:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe870c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923662:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923668:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923673:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923678:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.923681:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923687:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923698:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff916052b4c900) 00010000:00010000:1.0:1769074919.923701:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.923703:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923708:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8713 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074919.923745:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8705 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29929 expref: 285 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.923756:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.923759:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074919.923762:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8705 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29929 expref: 285 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.923771:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc -2) 00000100:00100000:1.0:1769074919.923850:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:2418:x1855007616044672:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 648us (1049us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074919.923858:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:2.0:1769074919.927357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.927717:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616044800 00000100:00100000:0.0:1769074919.927734:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616044800 00000100:00100000:0.0:1769074919.927806:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9234 00000100:00100000:0.0:1769074919.927818:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67204:x1855007616044800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.927855:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.927884:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe871a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29961 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.927976:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.927996:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928010:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928030:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074919.928037:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928044:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928113:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928121:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928128:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928133:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.928138:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928146:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928159:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.928162:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.928168:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928174:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8721 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928190:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928197:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928202:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928208:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074919.928211:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928217:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928224:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff91604ea4d100) 00010000:00010000:0.0:1769074919.928226:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.928229:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928234:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8728 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074919.928281:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe871a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29961 expref: 285 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.928292:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074919.928294:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074919.928298:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe871a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29961 expref: 285 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.928307:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.928393:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67204:x1855007616044800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 576us (1051us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074919.928401:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9234 00000100:00100000:2.0:1769074919.934128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.934235:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045056 00000100:00100000:1.0:1769074919.934260:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045056 00000100:00100000:1.0:1769074919.934341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9235 00000100:00100000:1.0:1769074919.934353:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+284:67204:x1855007616045056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074919.934381:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.934422:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe872f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29968 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.934637:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074919.934657:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.934671:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.934687:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074919.934694:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.934712:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074919.935615:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa6:0x0], index 1: 0 00010000:00010000:1.0:1769074919.935890:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe8744 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x155:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074919.935907:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe8744 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935918:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe8744 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935960:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935968:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935978:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935986:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.935992:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074919.935997:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.936006:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.936021:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074919.936025:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074919.936031:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.936036:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297000/0x557988ac98fe8736 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074919.936051:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3ed0d20 reply state 00000000396ff89f transno 4294968966 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.936063:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074919.936068:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff916052b4c900) 00010000:00010000:1.0:1769074919.936070:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074919.936073:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074919.936116:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe872f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29968 expref: 287 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.936137:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296200/0x557988ac98fe8744 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29968 expref: 286 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.936144:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x155:0x0].0x0 (ffff916052b4c500) 00010000:00010000:1.0:1769074919.936147:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074919.936149:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296200, rc 0) 00000100:00100000:1.0:1769074919.936249:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+287:67204:x1855007616045056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1887us (2127us total) trans 4294968966 rc 0/0 00000100:00100000:1.0:1769074919.936259:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9235 00000100:00100000:3.0:1769074919.942156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.942283:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045184 00000100:00100000:0.0:1769074919.942297:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045184 00000100:00100000:0.0:1769074919.942376:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2653 00000100:00100000:0.0:1769074919.942388:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+143:2420:x1855007616045184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074919.942426:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074919.942455:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2996f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074919.942486:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074919.942525:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.942573:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.942585:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.942607:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 144 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074919.942622:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074919.942716:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2420:x1855007616045184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 329us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074919.942724:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2653 00000100:00100000:2.0:1769074919.951629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074919.951745:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045312 00000100:00100000:1.0:1769074919.951760:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045312 00000100:00100000:1.0:1769074919.951831:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2654 00000100:00100000:1.0:1769074919.951842:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:67204:x1855007616045312:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074919.951879:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074919.951905:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29976 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.951944:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074919.951953:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.951955:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074919.951959:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29976 expref: 145 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074919.952002:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 145 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074919.952021:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 145 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:1.0:1769074919.952037:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626612736:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074919.952177:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a180 going to sleep for 11 seconds 00000100:00100000:1.0:1769074919.964454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074919.964612:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045440 00000100:00100000:0.0:1769074919.964627:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045440 00010000:00010000:0.0:1769074919.964706:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074919.964766:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1855 00000100:00100000:0.0:1769074919.964780:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2420:x1855007616045440:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074919.964799:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074919.964827:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074919.964844:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074919.964889:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.964892:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074919.964903:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29976 expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.964915:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29976 expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074919.964964:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29976 expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074919.964981:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626612864:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074919.965109:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5b40 going to sleep for 11 seconds 00010000:00010000:2.0:1769074919.965671:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8752 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2996f expref: 146 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:2.0:1769074919.965691:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626612736:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074919.965721:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e297000/0x557988ac98fe8759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29976 expref: 145 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.965733:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297000, rc 0) 00000100:00100000:2.0:1769074919.965788:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:67204:x1855007616045312:12345-192.168.204.32@tcp:101:cp.0 Request processed in 13947us (14174us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074919.965798:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2654 00000100:00100000:1.0:1769074919.970414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074919.970486:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045696 00000100:00100000:3.0:1769074919.970500:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045696 00000100:00100000:3.0:1769074919.970617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1840 00000100:00100000:3.0:1769074919.970630:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+287:67204:x1855007616045696:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074919.970798:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626612864:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074919.970826:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074919.971000:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2420:x1855007616045440:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6221us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074919.971000:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67204:x1855007616045696:12345-192.168.204.32@tcp:35:cp.0 Request processed in 372us (610us total) trans 4294968967 rc 0/0 00000100:00100000:0.0:1769074919.971010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1855 00000100:00100000:3.0:1769074919.971010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1840 00000100:00100000:3.0:1769074919.994524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074919.996697:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045824 00000100:00100000:2.0:1769074919.996718:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045824 00000100:00100000:2.0:1769074919.996809:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:2.0:1769074919.996822:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:2420:x1855007616045824:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074919.996910:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074919.996939:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8760 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2997d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.997020:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074919.997038:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997054:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997071:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074919.997082:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997088:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997155:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997163:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997170:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997177:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.997183:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997191:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997206:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.997210:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.997215:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997222:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8767 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997247:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997253:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997259:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997264:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074919.997267:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997272:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997279:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074919.997281:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074919.997284:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997290:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe876e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074919.997325:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8760 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2997d expref: 289 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.997336:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074919.997338:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074919.997341:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8760 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2997d expref: 289 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074919.997351:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc -2) 00000100:00100000:2.0:1769074919.997464:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:2420:x1855007616045824:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 644us (2954us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074919.997472:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:2.0:1769074920.005190:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.005306:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616045952 00000100:00100000:1.0:1769074920.005320:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616045952 00000100:00100000:1.0:1769074920.005413:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9236 00000100:00100000:1.0:1769074920.005425:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67211:x1855007616045952:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074920.005455:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.005485:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8775 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299b5 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.005621:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.005640:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005654:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005673:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.005680:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005688:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005756:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005765:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005772:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005778:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.005783:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005792:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005806:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.005810:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.005815:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005821:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297600/0x557988ac98fe877c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005837:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.005843:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006171:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006178:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.006181:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006188:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006197:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916052b4c600) 00010000:00010000:1.0:1769074920.006200:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.006203:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006208:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8783 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.006263:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8775 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299b5 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.006276:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.006279:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.006283:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8775 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299b5 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.006293:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296400, rc 0) 00000100:00100000:1.0:1769074920.006425:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67211:x1855007616045952:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1001us (1250us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.006434:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9236 00000100:00100000:2.0:1769074920.019233:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.019306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.019626:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046208 00000100:00100000:3.0:1769074920.019641:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046208 00000100:00100000:3.0:1769074920.019708:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:3.0:1769074920.019719:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:2420:x1855007616046208:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074920.019771:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.019800:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe878a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299c3 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.019883:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.019901:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.019915:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.019930:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.019936:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.019942:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020006:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020013:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020019:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020030:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.020035:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020043:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020055:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.020059:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.020064:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020070:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe8791 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020083:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020090:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020096:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020100:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.020103:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020108:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020114:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604e0bec00) 00010000:00010000:3.0:1769074920.020116:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.020119:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020124:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8798 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.020153:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe878a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299c3 expref: 289 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.020162:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.020165:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074920.020168:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe878a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299c3 expref: 289 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.020177:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ba00, rc -2) 00000100:00100000:3.0:1769074920.020270:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:2420:x1855007616046208:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 552us (962us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074920.020278:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:1.0:1769074920.026232:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046080 00000100:00100000:1.0:1769074920.026267:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046080 00000100:00100000:1.0:1769074920.026365:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9237 00000100:00100000:1.0:1769074920.026376:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67212:x1855007616046080:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074920.026417:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.026447:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe879f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.026575:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.026593:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026605:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026620:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.026627:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026632:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026704:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026712:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026718:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026725:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026732:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.026737:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026745:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026758:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.026762:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.026768:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026774:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026793:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026799:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026805:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026810:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.026813:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026819:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026827:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916052b4c700) 00010000:00010000:1.0:1769074920.026829:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.026833:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026838:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.026892:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe879f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299bc expref: 289 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.026903:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.026905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.026909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe879f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299bc expref: 289 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.026919:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074920.027012:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67212:x1855007616046080:12345-192.168.204.32@tcp:101:rm.0 Request processed in 637us (7792us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.027020:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9237 00000100:00100000:2.0:1769074920.031074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.031160:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046336 00000100:00100000:3.0:1769074920.031173:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046336 00000100:00100000:3.0:1769074920.031254:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9238 00000100:00100000:3.0:1769074920.031265:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67212:x1855007616046336:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074920.031293:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.031321:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299ca expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.031426:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.031446:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031459:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031476:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.031483:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031489:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031596:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031605:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031611:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031617:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.031621:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031629:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031642:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.031645:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.031650:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031655:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031669:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031675:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031681:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031685:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.031688:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031694:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031702:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff91604e0be200) 00010000:00010000:3.0:1769074920.031704:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.031707:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031713:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.031749:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87b4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ca expref: 289 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.031761:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.031763:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.031767:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ca expref: 289 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.031783:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.031873:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67212:x1855007616046336:12345-192.168.204.32@tcp:101:rm.0 Request processed in 609us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.031882:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9238 00000100:00100000:3.0:1769074920.045377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.045518:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046464 00000100:00100000:1.0:1769074920.045573:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046464 00000100:00100000:1.0:1769074920.045648:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9239 00000100:00100000:1.0:1769074920.045660:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67213:x1855007616046464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.045688:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.045715:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe87c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.045802:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.045819:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045834:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045862:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.045870:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045877:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045942:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045950:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045957:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045963:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045970:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.045975:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045983:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.045997:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.046001:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.046007:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046013:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe87d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046031:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046037:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046042:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046046:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.046049:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046054:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046060:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916052b4c700) 00010000:00010000:1.0:1769074920.046063:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.046065:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046071:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.046110:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe87c9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299d1 expref: 289 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.046121:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.046124:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.046128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe87c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299d1 expref: 289 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.046138:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074920.046226:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67213:x1855007616046464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 568us (865us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.046242:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9239 00000100:00100000:2.0:1769074920.049300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.049641:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046592 00000100:00100000:3.0:1769074920.049656:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046592 00000100:00100000:3.0:1769074920.049726:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9240 00000100:00100000:3.0:1769074920.049737:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67213:x1855007616046592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.049766:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.049794:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87de lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299d8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.049896:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.049916:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.049929:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.049946:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.049953:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.049960:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050034:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050042:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050048:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050054:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.050059:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050067:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050081:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.050085:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.050090:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050097:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe87e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050112:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050118:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050124:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050129:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.050132:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050138:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050145:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff91604e0be200) 00010000:00010000:3.0:1769074920.050147:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.050150:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050155:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe87ec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.050192:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87de lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299d8 expref: 289 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.050203:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.050205:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.050209:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe87de lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299d8 expref: 289 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.050220:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.050314:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67213:x1855007616046592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 578us (1029us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.050322:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9240 00000100:00100000:2.0:1769074920.057489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.060675:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046848 00000100:00100000:1.0:1769074920.060698:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046848 00000100:00100000:1.0:1769074920.060806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9241 00000100:00100000:1.0:1769074920.060818:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:67213:x1855007616046848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.060857:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.060887:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe87f3 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299df expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.061042:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.061060:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.061074:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.061091:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.061098:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.061104:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074920.061798:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa6:0x0], index 0: 0 00010000:00010000:1.0:1769074920.062162:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8808 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x156:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.062179:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8808 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x156:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062189:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8808 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x156:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062231:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062249:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062255:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062261:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062267:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.062272:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062280:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062294:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.062298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.062303:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062314:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe87fa lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074920.062332:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000440d32d8 reply state 00000000c54d802d transno 4294968968 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062342:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.062348:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916052b4c700) 00010000:00010000:1.0:1769074920.062350:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074920.062354:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074920.062407:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe87f3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299df expref: 291 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.062424:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296400/0x557988ac98fe8808 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x156:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299df expref: 290 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.062431:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x156:0x0].0x0 (ffff916052b4c600) 00010000:00010000:1.0:1769074920.062433:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074920.062436:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296400, rc 0) 00000100:00100000:1.0:1769074920.063017:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+291:67213:x1855007616046848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2197us (5538us total) trans 4294968968 rc 0/0 00000100:00100000:1.0:1769074920.063030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9241 00000100:00100000:2.0:1769074920.068023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.068138:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616046976 00000100:00100000:1.0:1769074920.068153:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616046976 00000100:00100000:1.0:1769074920.068275:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2655 00000100:00100000:1.0:1769074920.068288:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2420:x1855007616046976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.068313:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.068342:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299e6 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074920.068375:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074920.068415:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.068418:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.068430:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 146 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.068451:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 146 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.068467:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297a00, rc 0) 00000100:00100000:1.0:1769074920.068576:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2420:x1855007616046976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 291us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.068585:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2655 00000100:00100000:2.0:1769074920.072221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.072320:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047104 00000100:00100000:1.0:1769074920.072335:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047104 00000100:00100000:1.0:1769074920.072420:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2656 00000100:00100000:1.0:1769074920.072431:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:67213:x1855007616047104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.072456:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.072480:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299ed expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.072520:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.072564:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.072568:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.072574:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ed expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.072625:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.072642:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00000100:00100000:1.0:1769074920.072660:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181770e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626612992:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074920.072782:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1769074920.076408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.076561:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181770e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626612992:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074920.076607:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ed expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.076634:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297600, rc 0) 00000100:00100000:1.0:1769074920.076705:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:67213:x1855007616047104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4276us (4500us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.076715:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2656 00000100:00100000:0.0:1769074920.077047:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047232 00000100:00100000:0.0:1769074920.077058:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047232 00010000:00010000:0.0:1769074920.077123:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074920.077165:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1856 00000100:00100000:0.0:1769074920.077176:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616047232:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074920.077193:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074920.077220:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074920.077245:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074920.077274:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98fe8816 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299e6 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:0.0:1769074920.077290:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074920.077292:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074920.077301:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ed expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.077313:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ed expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.077362:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e297600/0x557988ac98fe881d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299ed expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074920.077380:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626613120:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074920.077472:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074920.082186:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626613120:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074920.082226:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074920.082314:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2419:x1855007616047232:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5138us (5931us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.082331:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1856 00000100:00100000:2.0:1769074920.086579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.086695:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047488 00000100:00100000:3.0:1769074920.086710:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047488 00000100:00100000:3.0:1769074920.086777:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1841 00000100:00100000:3.0:1769074920.086787:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+291:67213:x1855007616047488:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074920.087344:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67213:x1855007616047488:12345-192.168.204.32@tcp:35:cp.0 Request processed in 556us (776us total) trans 4294968969 rc 0/0 00000100:00100000:3.0:1769074920.087354:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1841 00000100:00100000:2.0:1769074920.119822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.120025:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047616 00000100:00100000:1.0:1769074920.120037:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047616 00000100:00100000:1.0:1769074920.120099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9242 00000100:00100000:1.0:1769074920.120107:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67216:x1855007616047616:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074920.120136:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.120166:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8824 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.120291:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.120310:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120324:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120341:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.120349:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120356:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120433:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120439:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120443:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120447:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120451:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.120455:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120464:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120476:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.120478:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.120482:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120487:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe882b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120501:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120505:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120509:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120512:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.120513:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120516:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120519:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff916052b4cb00) 00010000:00010000:1.0:1769074920.120521:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.120522:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8832 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.120614:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8824 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299f4 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.120622:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.120624:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.120626:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8824 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299f4 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.120633:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074920.120697:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67216:x1855007616047616:12345-192.168.204.32@tcp:101:bash.0 Request processed in 590us (888us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.120705:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9242 00000100:00100000:0.0:1769074920.131689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.131799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.131987:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047744 00000100:00100000:3.0:1769074920.132001:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047744 00000100:00100000:3.0:1769074920.132068:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9243 00000100:00100000:3.0:1769074920.132077:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67217:x1855007616047744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074920.132109:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.132137:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8839 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e299fb expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.132241:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.132261:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132275:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132293:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.132300:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132307:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132378:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132384:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132391:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132407:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.132412:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132420:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132434:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.132438:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.132444:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132450:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8840 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132465:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132471:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132476:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132482:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.132484:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132804:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132817:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:3.0:1769074920.132820:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.132823:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.132828:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8847 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.133004:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8839 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299fb expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.133017:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.133020:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.133024:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8839 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e299fb expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.133035:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.133129:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67217:x1855007616047744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1051us (1328us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.133137:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9243 00000100:00100000:2.0:1769074920.134331:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616047872 00000100:00100000:2.0:1769074920.134349:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616047872 00000100:00100000:2.0:1769074920.134433:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:2.0:1769074920.134444:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2420:x1855007616047872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074920.134502:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.134525:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe884e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a02 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.134618:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.134635:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134650:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134666:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.134678:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134683:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134749:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134757:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134764:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134773:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.134778:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134785:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134798:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.134803:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.134808:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134815:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8855 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134831:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134837:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.134843:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.135142:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.135145:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.135152:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.135160:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.135163:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.135166:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.135172:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe885c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.135210:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe884e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a02 expref: 293 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.135220:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.135222:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074920.135226:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe884e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a02 expref: 293 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.135244:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc -2) 00000100:00100000:2.0:1769074920.135341:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2420:x1855007616047872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 898us (3664us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074920.135351:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:0.0:1769074920.140461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.140813:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048000 00000100:00100000:3.0:1769074920.140831:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048000 00000100:00100000:3.0:1769074920.141084:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9244 00000100:00100000:3.0:1769074920.141097:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67217:x1855007616048000:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074920.141127:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.141155:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8863 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a09 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.141262:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.141282:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141297:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141314:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.141321:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141327:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141395:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141403:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141409:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141416:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.141421:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141429:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141444:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.141448:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.141453:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141460:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe886a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141472:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141478:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141482:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141488:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.141727:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141737:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141746:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:3.0:1769074920.141749:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.141753:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141763:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8871 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.141803:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8863 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a09 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.141815:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.141818:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.141822:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8863 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a09 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.141830:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.142094:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67217:x1855007616048000:12345-192.168.204.32@tcp:101:rm.0 Request processed in 998us (1652us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.142104:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9244 00000100:00100000:0.0:1769074920.156917:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.157094:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048128 00000100:00100000:3.0:1769074920.157109:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048128 00000100:00100000:3.0:1769074920.157182:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9245 00000100:00100000:3.0:1769074920.157192:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67218:x1855007616048128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.157219:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.157256:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8878 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a10 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.157343:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.157362:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157379:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157396:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.157403:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157410:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157481:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157489:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157681:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157688:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.157692:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157701:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157716:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.157719:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.157725:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157731:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe887f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157748:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157754:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157760:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157765:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.157768:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157774:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157782:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:3.0:1769074920.157784:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.157787:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157792:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8886 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.157836:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8878 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a10 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.157848:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.157850:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.157854:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8878 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a10 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.157869:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.157942:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67218:x1855007616048128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 751us (1041us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.157951:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9245 00000100:00100000:2.0:1769074920.167446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.167641:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048256 00000100:00100000:3.0:1769074920.167655:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048256 00000100:00100000:3.0:1769074920.167732:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9246 00000100:00100000:3.0:1769074920.167744:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67218:x1855007616048256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.167771:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.167802:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe888d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a17 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.167898:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.167918:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.167931:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.167948:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.167954:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.167960:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168038:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168046:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168053:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168060:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.168064:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168073:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168088:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.168092:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.168097:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168103:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe8894 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168119:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168126:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168132:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168137:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.168140:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168146:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168154:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:3.0:1769074920.168156:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.168159:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168164:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe889b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.168204:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe888d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a17 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.168217:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.168219:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.168223:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe888d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a17 expref: 293 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.168245:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.168331:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67218:x1855007616048256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 589us (903us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.168339:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9246 00000100:00100000:0.0:1769074920.173304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.173834:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048512 00000100:00100000:3.0:1769074920.173852:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048512 00000100:00100000:3.0:1769074920.173931:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9247 00000100:00100000:3.0:1769074920.173943:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:67218:x1855007616048512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.173975:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.174001:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe88a2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a1e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.174164:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.174184:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.174197:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.174213:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x24894c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.174221:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.174227:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074920.175039:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa7:0x0], index 1: 0 00010000:00010000:3.0:1769074920.175250:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe88b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x157:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.175264:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe88b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x157:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175275:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe88b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x157:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175319:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175328:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175335:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175341:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.175347:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175355:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175369:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.175372:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.175378:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175384:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88a9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074920.175398:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015770465 reply state 0000000080f83017 transno 4294968970 ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175411:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.175416:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:3.0:1769074920.175419:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074920.175422:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074920.175465:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe88a2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a1e expref: 295 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.175489:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ba00/0x557988ac98fe88b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x157:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a1e expref: 294 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.177489:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x157:0x0].0x0 (ffff91604e0bec00) 00010000:00010000:3.0:1769074920.178054:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074920.178060:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ba00, rc 0) 00000100:00100000:2.0:1769074920.178368:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+295:67218:x1855007616048512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4420us (5072us total) trans 4294968970 rc 0/0 00000100:00100000:2.0:1769074920.178380:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9247 00000100:00100000:0.0:1769074920.184305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.189473:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048640 00000100:00100000:1.0:1769074920.189496:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048640 00000100:00100000:1.0:1769074920.189630:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2657 00000100:00100000:1.0:1769074920.189639:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+144:2418:x1855007616048640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.189662:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.189688:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a25 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074920.189719:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074920.189749:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.189752:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.189764:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 145 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.189785:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 145 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.189803:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc 0) 00000100:00100000:1.0:1769074920.189900:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2418:x1855007616048640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 260us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.189908:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2657 00000100:00100000:1.0:1769074920.194471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.194592:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048768 00000100:00100000:0.0:1769074920.194606:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048768 00000100:00100000:0.0:1769074920.194674:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2658 00000100:00100000:0.0:1769074920.194684:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:67218:x1855007616048768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.194716:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.194738:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a2c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.194776:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074920.194784:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074920.194787:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074920.194792:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a2c expref: 146 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.194839:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074920.194856:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074920.194880:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626613248:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074920.195013:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5480 going to sleep for 11 seconds 00000100:00100000:2.0:1769074920.202079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.202170:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626613248:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074920.202182:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616048896 00000100:00100000:3.0:1769074920.202192:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616048896 00010000:00010000:0.0:1769074920.202219:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a2c expref: 147 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.202259:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15e00, rc 0) 00000100:00100000:0.0:1769074920.202338:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:67218:x1855007616048768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7653us (7881us total) trans 0 rc 0/0 00010000:00010000:3.0:1769074920.202340:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 147 pid: 8405 timeout: 2009 lvb_type: 1 00000100:00100000:0.0:1769074920.202348:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2658 00000100:00100000:3.0:1769074920.203363:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1857 00000100:00100000:3.0:1769074920.203382:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2419:x1855007616048896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074920.203401:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074920.203431:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:3.0:1769074920.203450:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:3.0:1769074920.203480:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe88c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a25 expref: 146 pid: 8405 timeout: 2009 lvb_type: 1 00010000:00010000:3.0:1769074920.203498:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.203501:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.203513:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a2c expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.203528:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a2c expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.203701:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b15e00/0x557988ac98fe88cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a2c expref: 145 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074920.203719:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626613376:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074920.203816:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074920.208750:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626613376:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074920.208792:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074920.209064:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2419:x1855007616048896:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5687us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.209076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1857 00000100:00100000:0.0:1769074920.214348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.214602:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049152 00000100:00100000:3.0:1769074920.214616:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049152 00000100:00100000:3.0:1769074920.214696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1842 00000100:00100000:3.0:1769074920.214707:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916148473050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+295:67218:x1855007616049152:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074920.215712:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916148473050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67218:x1855007616049152:12345-192.168.204.32@tcp:35:cp.0 Request processed in 998us (1371us total) trans 4294968971 rc 0/0 00000100:00100000:3.0:1769074920.215725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1842 00000100:00100000:1.0:1769074920.254295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.254396:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049280 00000100:00100000:2.0:1769074920.254411:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049280 00000100:00100000:2.0:1769074920.254497:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9248 00000100:00100000:2.0:1769074920.254515:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67222:x1855007616049280:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074920.254570:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.254599:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe88d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a33 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.254694:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074920.254714:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254728:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254745:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074920.254752:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254759:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254854:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254862:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254869:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254875:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.254880:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254889:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254905:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.254909:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.254914:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254920:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe88da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254935:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254941:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254946:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254951:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.254953:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254963:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254970:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.254973:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.254976:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.254981:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe88e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.255021:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe88d3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a33 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.255032:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.255034:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.255038:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe88d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a33 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.255046:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:2.0:1769074920.255131:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67222:x1855007616049280:12345-192.168.204.32@tcp:101:bash.0 Request processed in 618us (852us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074920.255139:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9248 00000100:00100000:0.0:1769074920.272207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.272286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.272834:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049536 00000100:00100000:3.0:1769074920.272850:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049536 00000100:00100000:3.0:1769074920.272921:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:3.0:1769074920.272931:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:2420:x1855007616049536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074920.272984:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.273009:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe88e8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a3a expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.273083:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.273103:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.273116:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.273133:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.273141:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.273148:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.273229:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00000100:00100000:1.0:1769074920.273603:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049408 00000100:00100000:1.0:1769074920.273611:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049408 00000100:00100000:1.0:1769074920.273662:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9249 00000100:00100000:1.0:1769074920.273672:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:67223:x1855007616049408:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074920.273683:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.273696:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe88fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a41 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.273742:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074920.273873:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.273880:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.275086:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.275111:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.275143:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.275152:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.275164:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.275366:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.275374:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.275389:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.275997:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.276003:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.276012:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276020:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe88ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276045:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276052:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276059:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276065:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.276069:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276075:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276085:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e0be800) 00010000:00010000:3.0:1769074920.276088:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.276091:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276096:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe88f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.276148:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe88e8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a3a expref: 299 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.276160:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.276162:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074920.276166:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe88e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a3a expref: 299 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.276176:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc -2) 00010000:00010000:1.0:1769074920.276774:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.276785:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.276791:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.276796:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.276800:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.276804:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.276809:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277050:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.277053:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.277057:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277063:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8904 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277080:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277086:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277092:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277097:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.277100:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277105:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277112:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff916052b4c200) 00010000:00010000:1.0:1769074920.277114:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.277117:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277123:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe890b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.277166:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe88fd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a41 expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.277176:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.277178:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.277181:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe88fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a41 expref: 298 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.277191:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297a00, rc 0) 00000100:00100000:1.0:1769074920.278127:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:67223:x1855007616049408:12345-192.168.204.32@tcp:101:rm.0 Request processed in 4445us (5829us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.278142:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9249 00000100:00100000:3.0:1769074920.278633:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:2420:x1855007616049536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 5699us (6440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074920.278645:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:0.0:1769074920.282643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.282745:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049664 00000100:00100000:1.0:1769074920.282758:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049664 00000100:00100000:1.0:1769074920.282865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9250 00000100:00100000:1.0:1769074920.282878:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67223:x1855007616049664:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074920.282904:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.282932:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8912 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a48 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.283018:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.283036:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283050:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283064:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074920.283070:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283075:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283142:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283150:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283156:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283166:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283172:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.283177:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283185:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283199:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.283203:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.283209:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283214:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8919 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283245:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283251:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283256:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283262:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.283265:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283270:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283281:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff916052b4cf00) 00010000:00010000:1.0:1769074920.283284:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.283287:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283292:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe8920 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074920.283332:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8912 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a48 expref: 297 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.283343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.283346:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.283350:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8912 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a48 expref: 297 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.283360:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074920.283441:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67223:x1855007616049664:12345-192.168.204.32@tcp:101:rm.0 Request processed in 565us (811us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.283450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9250 00000100:00100000:0.0:1769074920.301751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.301927:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049792 00000100:00100000:3.0:1769074920.301941:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049792 00000100:00100000:3.0:1769074920.302016:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9251 00000100:00100000:3.0:1769074920.302027:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67224:x1855007616049792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.302055:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.302084:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8927 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a4f expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.302172:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.302189:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302203:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302244:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.302251:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302258:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302324:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302332:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302339:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302346:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.302352:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302360:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302374:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.302377:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.302383:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302400:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe892e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302416:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302422:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302428:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302433:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.302436:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302442:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302449:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff91604e0be800) 00010000:00010000:3.0:1769074920.302452:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.302454:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.302460:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8935 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.303137:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8927 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a4f expref: 297 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.303154:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.303156:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.303160:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8927 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a4f expref: 297 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.303173:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:3.0:1769074920.303285:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67224:x1855007616049792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1259us (1549us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.303295:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9251 00000100:00100000:0.0:1769074920.307508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.308914:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616049920 00000100:00100000:3.0:1769074920.308933:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616049920 00000100:00100000:3.0:1769074920.309078:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9252 00000100:00100000:3.0:1769074920.309090:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67224:x1855007616049920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.309116:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.309142:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe893c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a56 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.309248:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.309266:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309279:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309294:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.309301:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309307:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309373:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309380:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309387:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309734:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.309739:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309748:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309764:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.309768:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.309774:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309781:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe8943 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309798:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309803:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309809:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309815:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.309818:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309824:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309836:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff91604e0be800) 00010000:00010000:3.0:1769074920.309848:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.309851:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309857:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b600/0x557988ac98fe894a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.309901:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe893c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a56 expref: 297 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.309912:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.309915:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.309918:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe893c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a56 expref: 297 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.309928:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:3.0:1769074920.310011:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67224:x1855007616049920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 923us (2528us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.310020:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9252 00000100:00100000:0.0:1769074920.314164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.314353:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050176 00000100:00100000:3.0:1769074920.314367:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050176 00000100:00100000:3.0:1769074920.314802:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9253 00000100:00100000:3.0:1769074920.314815:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:67224:x1855007616050176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.314853:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.314880:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8951 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a5d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.315037:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.315056:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.315069:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.315085:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.315091:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.315097:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074920.315725:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa7:0x0], index 0: 0 00010000:00010000:3.0:1769074920.317347:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe8966 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x158:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074920.317372:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe8966 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x158:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074920.317386:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe8966 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x158:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318195:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318205:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318298:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318304:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.318309:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318316:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318332:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.318336:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.318341:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318348:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8958 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074920.318366:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c0641993 reply state 000000000aae4caf transno 4294968972 ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318380:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.318387:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff91604e0bea00) 00010000:00010000:0.0:1769074920.318389:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074920.318487:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074920.318617:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8951 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a5d expref: 299 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.318641:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a600/0x557988ac98fe8966 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x158:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a5d expref: 298 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.318649:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x158:0x0].0x0 (ffff91604e0be400) 00010000:00010000:0.0:1769074920.318652:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074920.318655:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a600, rc 0) 00000100:00100000:0.0:1769074920.318824:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:67224:x1855007616050176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4011us (4674us total) trans 4294968972 rc 0/0 00000100:00100000:0.0:1769074920.318835:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9253 00000100:00100000:0.0:1769074920.323125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.323329:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050304 00000100:00100000:3.0:1769074920.323343:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050304 00000100:00100000:3.0:1769074920.323677:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2659 00000100:00100000:3.0:1769074920.323690:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2419:x1855007616050304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.323718:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.323745:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a64 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074920.323775:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074920.323802:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.323805:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.323817:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.323838:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.323974:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:3.0:1769074920.324088:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616050304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 400us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.324097:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2659 00000100:00100000:0.0:1769074920.327932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.328052:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050432 00000100:00100000:3.0:1769074920.328065:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050432 00000100:00100000:3.0:1769074920.328171:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2660 00000100:00100000:3.0:1769074920.328183:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:67224:x1855007616050432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.328205:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.328247:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a6b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.328287:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.328301:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.328303:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.328309:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a6b expref: 148 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.328356:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.328372:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:3.0:1769074920.328387:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626613504:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074920.328523:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1769074920.332501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.332653:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626613504:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074920.332703:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a6b expref: 148 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.332731:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b600, rc 0) 00000100:00100000:3.0:1769074920.332803:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:67224:x1855007616050432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4621us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.332815:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2660 00000100:00100000:2.0:1769074920.334407:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050560 00000100:00100000:2.0:1769074920.334425:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050560 00010000:00010000:2.0:1769074920.334734:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:2.0:1769074920.334787:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1858 00000100:00100000:2.0:1769074920.334801:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2419:x1855007616050560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074920.334821:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074920.334983:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.335003:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.335039:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a200/0x557988ac98fe8974 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a64 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.335059:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.335061:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.335071:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a6b expref: 147 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.335084:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a6b expref: 147 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.335139:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6b600/0x557988ac98fe897b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a6b expref: 147 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074920.335157:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161485f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626613632:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074920.335376:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd540 going to sleep for 11 seconds 00000100:00100000:0.0:1769074920.340984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.341120:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161485f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626613632:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074920.341156:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074920.341254:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616050560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6455us (8779us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074920.341267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1858 00000100:00100000:3.0:1769074920.342079:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050816 00000100:00100000:3.0:1769074920.342092:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050816 00000100:00100000:3.0:1769074920.342155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1843 00000100:00100000:3.0:1769074920.342165:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:67224:x1855007616050816:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074920.342873:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67224:x1855007616050816:12345-192.168.204.32@tcp:35:cp.0 Request processed in 706us (1901us total) trans 4294968973 rc 0/0 00000100:00100000:3.0:1769074920.342883:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1843 00000100:00100000:3.0:1769074920.377358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.377502:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616050944 00000100:00100000:0.0:1769074920.377516:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616050944 00000100:00100000:0.0:1769074920.377648:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9254 00000100:00100000:0.0:1769074920.377660:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67227:x1855007616050944:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074920.377686:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.377724:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8982 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a72 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.377822:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074920.377983:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378001:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378022:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074920.378030:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378037:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378114:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378123:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378129:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378135:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.378139:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378147:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378162:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.378166:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.378171:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378178:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8989 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378193:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378200:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378206:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378299:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.378303:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378309:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378318:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604ea4d500) 00010000:00010000:0.0:1769074920.378321:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.378324:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378328:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8990 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.378368:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8982 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a72 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.378379:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.378381:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.378385:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8982 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a72 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.378406:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074920.378497:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67227:x1855007616050944:12345-192.168.204.32@tcp:101:bash.0 Request processed in 838us (1152us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.378506:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9254 00000100:00100000:2.0:1769074920.397589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.397644:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.397748:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051072 00000100:00100000:0.0:1769074920.397762:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051072 00000100:00100000:0.0:1769074920.397854:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9255 00000100:00100000:0.0:1769074920.397865:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67228:x1855007616051072:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074920.397900:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.397928:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8997 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a79 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.398016:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074920.398036:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398049:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398065:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074920.398072:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398078:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398158:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398165:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398173:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398179:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.398183:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398191:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398205:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.398208:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.398302:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398310:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe899e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398325:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398332:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398338:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398343:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.398346:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398353:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398366:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604ea4d500) 00010000:00010000:0.0:1769074920.398368:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.398371:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398377:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074920.398417:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8997 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a79 expref: 301 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.398429:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.398432:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.398435:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8997 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a79 expref: 301 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.398444:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074920.398583:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67228:x1855007616051072:12345-192.168.204.32@tcp:101:rm.0 Request processed in 718us (1008us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.398592:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9255 00000100:00100000:3.0:1769074920.399696:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051200 00000100:00100000:3.0:1769074920.399711:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051200 00000100:00100000:3.0:1769074920.399772:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:3.0:1769074920.399782:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:2417:x1855007616051200:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074920.399845:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.399947:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe89ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a80 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.400017:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.400034:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.400046:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.400062:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074920.400068:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.400075:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402812:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402835:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402843:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402850:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.402855:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402864:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402885:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.402888:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.402894:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402900:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe89b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402917:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402923:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402928:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402933:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.402935:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402944:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402951:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0be000) 00010000:00010000:3.0:1769074920.402953:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.402956:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.402961:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe89ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074920.403015:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe89ac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a80 expref: 301 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.403025:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.403028:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074920.403032:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6ae00/0x557988ac98fe89ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a80 expref: 301 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.403041:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ae00, rc -2) 00000100:00100000:3.0:1769074920.404769:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:2417:x1855007616051200:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 4974us (7109us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074920.404787:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:2.0:1769074920.410968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.411202:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051328 00000100:00100000:3.0:1769074920.411223:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051328 00000100:00100000:3.0:1769074920.411315:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9256 00000100:00100000:3.0:1769074920.411328:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67228:x1855007616051328:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074920.411355:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.411386:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe89c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.411496:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074920.411515:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411551:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411570:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074920.411576:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411583:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411663:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411671:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411677:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411684:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411691:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.411696:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411705:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411718:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.411721:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.411727:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411734:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe89c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411748:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411753:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411759:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411763:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.411765:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411771:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411778:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604e0bef00) 00010000:00010000:3.0:1769074920.411781:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.411784:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411790:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe89cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074920.411831:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe89c1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a87 expref: 301 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.411841:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.411844:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.411848:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe89c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a87 expref: 301 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.411859:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:3.0:1769074920.419643:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67228:x1855007616051328:12345-192.168.204.32@tcp:101:rm.0 Request processed in 8296us (8668us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.419662:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9256 00000100:00100000:2.0:1769074920.446436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.448033:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051456 00000100:00100000:3.0:1769074920.448054:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051456 00000100:00100000:0.0:1769074920.448467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9257 00000100:00100000:0.0:1769074920.448481:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67229:x1855007616051456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.448510:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.448567:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe89d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a8e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.448936:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.448959:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.448973:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.448992:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.448999:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449005:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449077:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449085:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449092:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449099:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449106:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.449388:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449398:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.449421:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.449427:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449434:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe89dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449453:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449459:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449464:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449469:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.449472:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449477:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449484:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604ea4d500) 00010000:00010000:0.0:1769074920.449487:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.449490:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe89e4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.449655:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe89d6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a8e expref: 301 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.449670:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.449673:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.449677:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe89d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a8e expref: 301 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.449688:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074920.449788:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67229:x1855007616051456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1308us (3365us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.449798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9257 00000100:00100000:0.0:1769074920.460046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.460398:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051584 00000100:00100000:1.0:1769074920.460415:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051584 00000100:00100000:1.0:1769074920.460505:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9258 00000100:00100000:1.0:1769074920.460517:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67229:x1855007616051584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.460570:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.460610:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe89eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a95 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.460713:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.460730:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.460745:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.460761:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.460767:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.460773:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461041:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461050:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461056:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461061:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.461066:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461073:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461091:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.461094:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.461100:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461107:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe89f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461189:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461194:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461199:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461204:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.461207:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461292:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461373:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff916052b4cf00) 00010000:00010000:1.0:1769074920.461376:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.461379:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461384:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe89f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.461435:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe89eb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a95 expref: 301 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.461447:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.461450:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.461454:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297400/0x557988ac98fe89eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a95 expref: 301 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.461463:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297400, rc 0) 00000100:00100000:1.0:1769074920.461661:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67229:x1855007616051584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1144us (1628us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.461670:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9258 00000100:00100000:3.0:1769074920.472186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.472444:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051840 00000100:00100000:0.0:1769074920.472459:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051840 00000100:00100000:0.0:1769074920.472645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9259 00000100:00100000:0.0:1769074920.472658:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:67229:x1855007616051840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.472687:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.472716:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8a00 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29a9c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.472895:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.472916:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.472930:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.472947:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.472954:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.472961:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074920.473822:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8:0x0], index 1: 0 00010000:00010000:0.0:1769074920.474044:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8a15 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x159:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.474061:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8a15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x159:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.474070:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8a15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x159:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476035:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476058:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476066:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476073:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476079:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.476085:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476094:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476127:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.476131:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.476138:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476144:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8a07 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074920.476167:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005625ae1f reply state 00000000d9756073 transno 4294968974 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476182:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.476190:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604ea4d500) 00010000:00010000:0.0:1769074920.476193:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074920.476198:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074920.476594:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8a00 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a9c expref: 303 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.476781:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15600/0x557988ac98fe8a15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x159:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29a9c expref: 302 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.476790:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x159:0x0].0x0 (ffff916181809800) 00010000:00010000:0.0:1769074920.476794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074920.476797:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15600, rc 0) 00000100:00100000:0.0:1769074920.476989:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+303:67229:x1855007616051840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4332us (4817us total) trans 4294968974 rc 0/0 00000100:00100000:0.0:1769074920.477000:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9259 00000100:00100000:2.0:1769074920.488068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.489357:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616051968 00000100:00100000:3.0:1769074920.489376:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616051968 00000100:00100000:3.0:1769074920.489662:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2661 00000100:00100000:3.0:1769074920.489675:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+145:2417:x1855007616051968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.490008:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.490040:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29aa3 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074920.490075:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074920.490103:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.490105:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.490117:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 146 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.490138:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 146 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.490154:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42800, rc 0) 00000100:00100000:3.0:1769074920.490251:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2417:x1855007616051968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 577us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.490259:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2661 00000100:00100000:3.0:1769074920.496831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.497054:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052096 00000100:00100000:1.0:1769074920.497069:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052096 00000100:00100000:1.0:1769074920.497176:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2662 00000100:00100000:1.0:1769074920.497187:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:67229:x1855007616052096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.497213:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.497252:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29aaa expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.497292:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.497302:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.497304:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.497308:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aaa expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.497353:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.497370:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:1.0:1769074920.497386:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626613760:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074920.497595:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9900 going to sleep for 11 seconds 00000100:00100000:1.0:1769074920.501483:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626613760:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074920.501493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:1.0:1769074920.501574:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aaa expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.501601:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297400, rc 0) 00000100:00100000:2.0:1769074920.501618:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052224 00000100:00100000:2.0:1769074920.501628:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052224 00000100:00100000:1.0:1769074920.501685:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:67229:x1855007616052096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4498us (4867us total) trans 0 rc 0/0 00010000:00010000:2.0:1769074920.501686:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 148 pid: 25313 timeout: 2009 lvb_type: 1 00000100:00100000:1.0:1769074920.501706:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2662 00000100:00100000:2.0:1769074920.501735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1859 00000100:00100000:2.0:1769074920.501745:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616052224:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074920.501757:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074920.501778:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.501791:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.501819:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8a23 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aa3 expref: 147 pid: 25313 timeout: 2009 lvb_type: 1 00010000:00010000:2.0:1769074920.501844:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.501846:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.501856:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aaa expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.501868:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aaa expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.501907:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e297400/0x557988ac98fe8a2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29aaa expref: 146 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074920.501922:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626613888:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074920.501990:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074920.507466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.507568:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052480 00000100:00100000:0.0:1769074920.507583:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052480 00000100:00100000:0.0:1769074920.507795:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1844 00000100:00100000:0.0:1769074920.507809:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+303:67229:x1855007616052480:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074920.507825:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626613888:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074920.507923:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074920.508201:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67229:x1855007616052480:12345-192.168.204.32@tcp:35:cp.0 Request processed in 395us (759us total) trans 4294968975 rc 0/0 00000100:00100000:0.0:1769074920.508219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1844 00000100:00100000:2.0:1769074920.508630:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2419:x1855007616052224:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6884us (7138us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074920.508639:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1859 00000100:00100000:3.0:1769074920.547003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.547261:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052608 00000100:00100000:1.0:1769074920.547277:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052608 00000100:00100000:1.0:1769074920.547357:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:1.0:1769074920.547369:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:2417:x1855007616052608:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074920.547425:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.547452:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8a31 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ab1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.547610:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.547629:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547644:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547662:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.547668:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547675:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547744:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547753:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547760:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547766:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.547772:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547780:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547795:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.547798:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.547805:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547810:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8a38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547827:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.547832:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.549945:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.549964:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.549969:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.549978:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.549997:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff916052b4cf00) 00010000:00010000:1.0:1769074920.550001:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.550005:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.550012:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8a3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.550078:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8a31 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ab1 expref: 305 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.550089:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.550091:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074920.550095:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8a31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ab1 expref: 305 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.550110:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc -2) 00000100:00100000:1.0:1769074920.550220:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:2417:x1855007616052608:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2852us (3233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074920.550242:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:1.0:1769074920.553347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.553949:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052736 00000100:00100000:0.0:1769074920.553966:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052736 00000100:00100000:0.0:1769074920.554100:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9260 00000100:00100000:0.0:1769074920.554124:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67232:x1855007616052736:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074920.554152:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.554178:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a46 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ab8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.554281:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.554309:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554322:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554342:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074920.554348:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554354:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554429:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554437:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554444:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554451:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554458:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.554463:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554470:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554484:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.554488:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.554493:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554498:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8a4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554514:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554520:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554526:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554562:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.554565:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554571:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554578:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff91604f15f100) 00010000:00010000:0.0:1769074920.554581:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.554584:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554590:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8a54 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074920.554626:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a46 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ab8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.554638:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.554640:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.554644:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a46 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ab8 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.554653:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074920.554739:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67232:x1855007616052736:12345-192.168.204.32@tcp:101:bash.0 Request processed in 618us (1404us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.554748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9260 00000100:00100000:3.0:1769074920.563703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.564225:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052864 00000100:00100000:1.0:1769074920.564251:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052864 00000100:00100000:1.0:1769074920.564429:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9261 00000100:00100000:1.0:1769074920.564441:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67233:x1855007616052864:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074920.564498:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.564577:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8a5b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29abf expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.564686:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.564705:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564720:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564758:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.564779:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564786:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564914:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564922:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564929:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564936:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.564941:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564949:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564963:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.564967:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.564973:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564979:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8a62 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.564996:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565002:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565007:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565012:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.565016:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565021:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565028:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff916052b4c200) 00010000:00010000:1.0:1769074920.565031:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.565034:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565039:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8a69 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.565080:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8a5b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29abf expref: 305 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.565091:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.565115:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.565119:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8a5b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29abf expref: 305 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.565147:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297a00, rc 0) 00000100:00100000:1.0:1769074920.565297:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67233:x1855007616052864:12345-192.168.204.32@tcp:101:rm.0 Request processed in 857us (1618us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.567157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.569359:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.570000:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053120 00000100:00100000:2.0:1769074920.570014:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053120 00000100:00100000:2.0:1769074920.570070:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9262 00000100:00100000:2.0:1769074920.570080:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:67233:x1855007616053120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074920.570106:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.570132:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8a70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29afe expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.570220:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00000100:00100000:3.0:1769074920.571170:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616052992 00000100:00100000:3.0:1769074920.571182:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616052992 00010000:00010000:2.0:1769074920.571354:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.571375:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000100:00100000:3.0:1769074920.571556:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 122 00000100:00100000:3.0:1769074920.571568:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2420:x1855007616052992:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074920.571630:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.571644:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8a7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ac6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.571793:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074920.571802:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.572317:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074920.572488:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.572620:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.572628:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.572635:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074920.572682:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572705:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572722:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074920.572728:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572735:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572775:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572782:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572788:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572795:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.572800:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572818:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572834:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.572844:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.572850:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572856:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8a8c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572870:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572876:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572881:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572886:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.572889:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572895:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572901:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604e0be300) 00010000:00010000:3.0:1769074920.572903:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.572905:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572911:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8a93 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074920.572952:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8a7e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ac6 expref: 308 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.572963:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.572965:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074920.572970:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8a7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ac6 expref: 308 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074920.572975:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9261 00010000:00010000:3.0:1769074920.572992:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42200, rc -2) 00000100:00100000:3.0:1769074920.573099:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:2420:x1855007616052992:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1533us (5950us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074920.573108:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 122 00010000:00010000:2.0:1769074920.578326:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.578345:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578363:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578401:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.578406:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.578413:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578422:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8a77 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578449:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578456:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578464:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578470:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.578473:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578479:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578487:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.578490:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.578493:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578499:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8a85 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074920.578597:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8a70 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29afe expref: 305 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.578611:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.578614:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.578619:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8a70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29afe expref: 305 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.578636:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adac00, rc 0) 00000100:00100000:2.0:1769074920.578773:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67233:x1855007616053120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 8682us (9414us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074920.578785:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9262 00010000:00010000:2.0:1769074920.628597:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074920.634767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.634905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.635043:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053248 00000100:00100000:0.0:1769074920.635058:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053248 00000100:00100000:0.0:1769074920.635138:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9263 00000100:00100000:0.0:1769074920.635150:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67236:x1855007616053248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.635177:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.635203:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a9a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b05 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.635304:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.635322:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635336:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635352:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.635358:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635364:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635431:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635451:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635459:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635465:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.635470:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635478:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635493:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.635497:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.635503:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635509:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8aa1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635524:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635575:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635582:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635586:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.635589:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635595:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635602:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff91604f15f100) 00010000:00010000:0.0:1769074920.635604:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.635607:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635616:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8aa8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.635654:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a9a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b05 expref: 305 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.635665:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.635668:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.635671:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8a9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b05 expref: 305 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.635680:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074920.635751:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67236:x1855007616053248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 604us (845us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.635759:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9263 00000100:00100000:3.0:1769074920.638848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.640384:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053504 00000100:00100000:1.0:1769074920.640407:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053504 00000100:00100000:1.0:1769074920.640501:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9264 00000100:00100000:1.0:1769074920.640514:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67236:x1855007616053504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.640560:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.640588:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8aaf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b44 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.640676:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.640695:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640708:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640725:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.640732:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640738:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640810:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640818:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640824:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640842:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.640847:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640860:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640873:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.640877:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.640882:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640888:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ab6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640904:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640910:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640917:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640923:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.640936:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640943:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640952:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff916052b4c200) 00010000:00010000:1.0:1769074920.640955:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.640957:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.640963:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8abd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.641004:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8aaf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b44 expref: 305 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.641015:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.641017:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.641021:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8aaf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b44 expref: 305 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.641030:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:1.0:1769074920.641130:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:67236:x1855007616053504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 618us (2297us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.641138:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9264 00000100:00100000:2.0:1769074920.641595:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053376 00000100:00100000:2.0:1769074920.641604:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053376 00000100:00100000:2.0:1769074920.641658:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:2.0:1769074920.641667:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+304:2417:x1855007616053376:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074920.641727:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.641742:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ac4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b0c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.641791:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.641803:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.641813:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.641827:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.641833:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644503:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00000100:00100000:3.0:1769074920.644521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.644595:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053760 00010000:00010000:2.0:1769074920.644603:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00000100:00100000:1.0:1769074920.644610:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053760 00010000:00010000:2.0:1769074920.644612:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644622:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644629:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.644634:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644643:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644660:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.644665:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.644670:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644677:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8acb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00000100:00100000:1.0:1769074920.644682:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9265 00000100:00100000:1.0:1769074920.644701:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:67236:x1855007616053760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074920.644701:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644713:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644718:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644723:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.644727:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.644733:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.644733:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644744:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.644747:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.644750:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.644756:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8ad2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.644758:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8ad9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b4b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.644801:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ac4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b0c expref: 307 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.644813:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.644815:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074920.644819:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ac4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b0c expref: 307 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.644829:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adac00, rc -2) 00010000:00010000:1.0:1769074920.644885:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.644903:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.644911:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.644932:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa887316a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00000100:00100000:2.0:1769074920.644933:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:2417:x1855007616053376:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3266us (10180us total) trans 0 rc -2/-2 00010000:00010000:1.0:1769074920.644950:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00000100:00100000:2.0:1769074920.644954:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 123 00010000:00010000:1.0:1769074920.644963:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074920.645697:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8:0x0], index 0: 0 00010000:00010000:1.0:1769074920.650035:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8aee lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.650070:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8aee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650087:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8aee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650160:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650170:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650177:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650183:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.650189:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650197:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650213:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.650217:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.650222:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650237:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8ae0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074920.650255:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000515f5afe reply state 0000000078caa40d transno 4294968976 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650268:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.650274:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff916052b4cf00) 00010000:00010000:1.0:1769074920.650277:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074920.650280:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074920.650340:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe8ad9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b4b expref: 307 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.650356:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296000/0x557988ac98fe8aee lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b4b expref: 306 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.650364:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15a:0x0].0x0 (ffff916052b4c800) 00010000:00010000:1.0:1769074920.650367:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074920.650371:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296000, rc 0) 00000100:00100000:1.0:1769074920.650474:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:67236:x1855007616053760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5780us (5958us total) trans 4294968976 rc 0/0 00000100:00100000:1.0:1769074920.650485:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9265 00000100:00100000:3.0:1769074920.655680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.655791:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616053888 00000100:00100000:1.0:1769074920.655807:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616053888 00000100:00100000:1.0:1769074920.656250:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2663 00000100:00100000:1.0:1769074920.656263:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616053888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.656290:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.656333:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b52 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074920.656370:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074920.656399:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.656401:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.656413:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 148 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.656437:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 148 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.656454:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc 0) 00000100:00100000:1.0:1769074920.656588:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2419:x1855007616053888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 327us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.656597:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2663 00000100:00100000:0.0:1769074920.664182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.664251:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054016 00000100:00100000:3.0:1769074920.664266:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054016 00000100:00100000:3.0:1769074920.664357:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2664 00000100:00100000:3.0:1769074920.664370:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:67236:x1855007616054016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.664395:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.664422:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b59 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.664467:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.664477:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.664479:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.664484:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b59 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.664571:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.664590:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 2010 lvb_type: 1 00000100:00100000:3.0:1769074920.664608:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626614016:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074920.664748:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1769074920.668968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.669196:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626614016:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074920.669256:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b59 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.669281:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6ae00, rc 0) 00000100:00100000:3.0:1769074920.669361:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:67236:x1855007616054016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4994us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.669372:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2664 00000100:00100000:2.0:1769074920.671602:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054144 00000100:00100000:2.0:1769074920.671624:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054144 00010000:00010000:2.0:1769074920.671718:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074920.671786:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1860 00000100:00100000:2.0:1769074920.671798:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916180fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2419:x1855007616054144:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074920.671819:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074920.671848:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074920.671865:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074920.671896:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e296e00/0x557988ac98fe8afc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b52 expref: 149 pid: 8405 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074920.671918:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.671920:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.671928:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b59 expref: 148 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.671940:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b59 expref: 148 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.671992:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6ae00/0x557988ac98fe8b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b59 expref: 148 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074920.672009:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626614144:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074920.672140:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbda80 going to sleep for 11 seconds 00000100:00100000:0.0:1769074920.681180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.681424:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626614144:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074920.681453:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054400 00000100:00100000:1.0:1769074920.681466:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054400 00010000:00010000:3.0:1769074920.681467:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074920.681582:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916180fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2419:x1855007616054144:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9785us (12627us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.681594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1860 00000100:00100000:2.0:1769074920.692393:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1845 00000100:00100000:2.0:1769074920.692411:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:67236:x1855007616054400:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074920.692858:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67236:x1855007616054400:12345-192.168.204.32@tcp:35:cp.0 Request processed in 449us (11691us total) trans 4294968977 rc 0/0 00000100:00100000:2.0:1769074920.692868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1845 00000100:00100000:0.0:1769074920.733420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.733588:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054528 00000100:00100000:2.0:1769074920.733600:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054528 00000100:00100000:2.0:1769074920.733677:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:2.0:1769074920.733689:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2419:x1855007616054528:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074920.733770:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.733796:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b60 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.733890:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.733910:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.733923:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.733940:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074920.733947:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.733953:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734031:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734039:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734046:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734053:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.734058:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734066:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734080:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.734084:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.734090:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734096:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734126:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734133:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734138:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734143:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.734146:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734151:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734158:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.734161:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.734163:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734168:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b18 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074920.734202:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b0a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b60 expref: 309 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.734213:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.734215:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074920.734219:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b60 expref: 309 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.734238:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc -2) 00000100:00100000:2.0:1769074920.734322:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2419:x1855007616054528:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 635us (917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074920.734331:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:3.0:1769074920.745764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.745957:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054656 00000100:00100000:1.0:1769074920.745971:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054656 00000100:00100000:1.0:1769074920.746049:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9266 00000100:00100000:1.0:1769074920.746060:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67243:x1855007616054656:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074920.746085:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.746119:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8b1f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b98 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.746206:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.746234:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746250:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746268:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074920.746275:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746281:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746348:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746354:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746361:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746367:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.746373:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746382:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746401:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.746405:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.746411:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746416:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8b26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746433:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746439:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746445:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746450:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.746453:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746459:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746466:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604ec78000) 00010000:00010000:1.0:1769074920.746469:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.746471:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746477:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8b2d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074920.746513:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8b1f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b98 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.746524:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.746527:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.746601:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8b1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b98 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.746612:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296600, rc 0) 00000100:00100000:1.0:1769074920.746690:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67243:x1855007616054656:12345-192.168.204.32@tcp:101:bash.0 Request processed in 631us (941us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.746697:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9266 00000100:00100000:0.0:1769074920.764393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.764523:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054912 00000100:00100000:1.0:1769074920.764580:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054912 00000100:00100000:1.0:1769074920.764662:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:1.0:1769074920.764675:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2418:x1855007616054912:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074920.764761:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.764790:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8b34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29b9f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.764885:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.764903:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.764917:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.764935:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.764947:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.764954:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765025:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765033:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765041:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765048:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.765052:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765061:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765076:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.765080:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.765085:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765092:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8b3b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765272:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765280:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765287:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765292:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.765296:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765302:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765311:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604ec78000) 00010000:00010000:1.0:1769074920.765314:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.765317:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765324:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8b42 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.765364:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8b34 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b9f expref: 309 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.765376:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.765379:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074920.765383:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8b34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29b9f expref: 309 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.765394:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7e00, rc -2) 00000100:00100000:3.0:1769074920.765427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.765594:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2418:x1855007616054912:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 921us (1217us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074920.765605:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:0.0:1769074920.766017:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616054784 00000100:00100000:0.0:1769074920.766025:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616054784 00000100:00100000:0.0:1769074920.766080:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9267 00000100:00100000:0.0:1769074920.766088:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67244:x1855007616054784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074920.766110:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.766124:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8b49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ba6 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.766185:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.766197:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766206:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766220:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.766235:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766242:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766282:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766288:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766304:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766318:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.766321:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766327:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766341:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.766344:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.766347:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766353:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8b50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766364:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766370:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766376:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766381:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.766384:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766390:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766397:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f15f100) 00010000:00010000:0.0:1769074920.766399:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.766402:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766407:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8b57 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.766433:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8b49 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ba6 expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.766443:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.766445:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.766449:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8b49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ba6 expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.766458:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15400, rc 0) 00000100:00100000:0.0:1769074920.770256:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67244:x1855007616054784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 4149us (4811us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.770274:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9267 00000100:00100000:3.0:1769074920.774246:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.774387:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055040 00000100:00100000:0.0:1769074920.774404:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055040 00000100:00100000:0.0:1769074920.774485:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9268 00000100:00100000:0.0:1769074920.774497:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67244:x1855007616055040:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074920.774523:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.774585:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29bde expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.774676:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.774693:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.774706:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.774748:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.774762:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.774770:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775040:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775049:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775056:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775064:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.775069:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775077:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775091:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.775095:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.775100:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775106:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b65 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775121:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775127:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775133:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775138:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.775141:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775147:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775154:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074920.775157:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.775159:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775165:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b6c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.775201:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b5e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29bde expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.775212:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.775215:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.775219:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29bde expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.775237:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15a00, rc 0) 00000100:00100000:0.0:1769074920.775667:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67244:x1855007616055040:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1170us (1444us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.775676:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9268 00000100:00100000:3.0:1769074920.797140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.797203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.797732:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055296 00000100:00100000:2.0:1769074920.797749:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055296 00000100:00100000:2.0:1769074920.797829:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:2.0:1769074920.797842:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2418:x1855007616055296:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074920.797925:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.797953:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29bec expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.798034:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074920.798053:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798066:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798083:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074920.798089:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798095:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798166:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798174:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798181:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798187:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.798193:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798206:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798233:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.798236:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.798242:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798248:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8b7a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798263:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798270:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798276:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798281:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.798285:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798291:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798298:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.798301:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.798303:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798309:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8b81 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074920.798354:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b73 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29bec expref: 309 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.798372:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.798375:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074920.798379:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29bec expref: 309 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.798390:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc -2) 00000100:00100000:2.0:1769074920.798491:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2418:x1855007616055296:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 651us (1286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074920.798500:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:0.0:1769074920.800236:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055168 00000100:00100000:0.0:1769074920.800253:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055168 00000100:00100000:0.0:1769074920.800347:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9269 00000100:00100000:0.0:1769074920.800357:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67247:x1855007616055168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.800381:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.800407:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29be5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.800491:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.800507:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800520:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800587:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.800595:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800603:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800678:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800686:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800692:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800699:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.800704:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800711:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800725:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.800728:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.800733:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800739:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8b8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800752:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800758:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800764:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800769:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.800772:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800779:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800786:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074920.800788:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.800792:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800797:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8b96 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.800832:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b88 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29be5 expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.800843:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.800845:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.800849:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8b88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29be5 expref: 309 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.800858:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15a00, rc 0) 00000100:00100000:0.0:1769074920.800943:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67247:x1855007616055168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 586us (3818us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.800951:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9269 00000100:00100000:1.0:1769074920.808450:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.808584:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055424 00000100:00100000:2.0:1769074920.808598:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055424 00000100:00100000:2.0:1769074920.808672:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9270 00000100:00100000:2.0:1769074920.808683:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67247:x1855007616055424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074920.808724:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.808749:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c24 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.808830:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074920.808859:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808870:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808885:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074920.808889:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808893:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808951:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808956:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808960:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808965:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.808968:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808974:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808983:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.808986:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.808990:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.808993:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8ba4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809005:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809009:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809013:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809015:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052ada000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.809017:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809020:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809023:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.809024:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.809026:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809028:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052ada000/0x557988ac98fe8bab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074920.809056:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b9d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c24 expref: 309 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.809062:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.809063:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.809066:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8b9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c24 expref: 309 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.809071:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:2.0:1769074920.809139:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67247:x1855007616055424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 458us (709us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074920.809146:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9270 00000100:00100000:3.0:1769074920.812061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.812162:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055680 00000100:00100000:0.0:1769074920.812177:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055680 00000100:00100000:0.0:1769074920.812259:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9271 00000100:00100000:0.0:1769074920.812270:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:67247:x1855007616055680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074920.812307:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.812334:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8bb2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c2b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.812504:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.812525:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.812573:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.812592:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.812600:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.812614:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074920.813033:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa9:0x0], index 1: 0 00010000:00010000:0.0:1769074920.813249:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8bc7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074920.813259:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813267:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813310:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813317:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813323:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813329:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.813333:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813341:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813356:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.813359:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.813365:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813371:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8bb9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074920.813385:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e24aac11 reply state 000000006be022b3 transno 4294968978 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813397:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074920.813402:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074920.813405:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074920.813407:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074920.813445:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8bb2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c2b expref: 311 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.813461:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15400/0x557988ac98fe8bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c2b expref: 310 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.813468:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15b:0x0].0x0 (ffff91604f3c6f00) 00010000:00010000:0.0:1769074920.813471:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074920.813474:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15400, rc 0) 00000100:00100000:0.0:1769074920.813593:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+311:67247:x1855007616055680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1325us (1543us total) trans 4294968978 rc 0/0 00000100:00100000:0.0:1769074920.813607:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9271 00000100:00100000:1.0:1769074920.818090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.818645:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055808 00000100:00100000:3.0:1769074920.818663:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055808 00000100:00100000:3.0:1769074920.821152:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2665 00000100:00100000:3.0:1769074920.821181:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+146:2420:x1855007616055808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.821210:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.821250:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c32 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074920.821283:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074920.821311:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.821313:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.821323:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.821347:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 147 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.821363:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:3.0:1769074920.821463:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2420:x1855007616055808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 298us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074920.821471:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2665 00000100:00100000:1.0:1769074920.833412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.833611:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616055936 00000100:00100000:2.0:1769074920.833625:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616055936 00000100:00100000:2.0:1769074920.833820:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2666 00000100:00100000:2.0:1769074920.833835:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:67247:x1855007616055936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074920.833862:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.833886:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c39 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.834784:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074920.834799:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.834802:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074920.834807:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c39 expref: 148 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.834859:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074920.834878:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074920.834901:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626614272:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074920.835040:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1769074920.838886:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626614272:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074920.838938:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c39 expref: 148 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.838964:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052ada000, rc 0) 00000100:00100000:1.0:1769074920.839038:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:67247:x1855007616055936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5207us (5641us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.839048:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2666 00000100:00100000:1.0:1769074920.851487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.851799:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056064 00000100:00100000:3.0:1769074920.851815:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056064 00010000:00010000:3.0:1769074920.851899:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:3.0:1769074920.851948:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1861 00000100:00100000:3.0:1769074920.851960:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2419:x1855007616056064:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074920.851982:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074920.852011:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:3.0:1769074920.852026:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:3.0:1769074920.852057:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c32 expref: 148 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:3.0:1769074920.852077:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.852079:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.852087:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c39 expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.852098:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c39 expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.852154:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052ada000/0x557988ac98fe8bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c39 expref: 147 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074920.852170:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626614400:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074920.852302:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1769074920.858481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074920.858951:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056320 00000100:00100000:2.0:1769074920.858965:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056320 00000100:00100000:2.0:1769074920.859043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1846 00000100:00100000:2.0:1769074920.859057:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+311:67247:x1855007616056320:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074920.860874:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67247:x1855007616056320:12345-192.168.204.32@tcp:35:cp.0 Request processed in 1806us (2391us total) trans 4294968979 rc 0/0 00000100:00100000:2.0:1769074920.860891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1846 00000100:00100000:3.0:1769074920.861370:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626614400:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074920.861415:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074920.861757:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616056064:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9797us (10283us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074920.861768:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1861 00000100:00100000:0.0:1769074920.883843:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626614528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074920.884400:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.885493:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1769074920.885515:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626614656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074920.885607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.885730:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1769074920.885742:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626614784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1769074920.885791:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.885833:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e86036b9-84bb-449e-baba-8ef95d66b0fb:3657:1855007626614912:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.885862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.885912:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626614912 00000100:00100000:0.0:1769074920.885920:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626614912 00000100:00100000:0.0:1769074920.885965:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1769074920.885974:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604361a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3657:x1855007626614912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886024:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604361a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3657:x1855007626614912:12345-0@lo:400:kworker.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074920.886031:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1769074920.886076:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e86036b9-84bb-449e-baba-8ef95d66b0fb:3657:1855007626614912:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.886218:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1855007626615040:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.886290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074920.886315:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626615552:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.886328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074920.886337:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1855007626616064:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.886348:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074920.886365:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1769074920.886368:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626615168:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886425:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1855007626615424:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886464:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.886501:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626615936:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886647:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.886671:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1769074920.886677:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1855007626615296:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886700:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.886720:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626615808:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.886738:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074920.886819:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626614784 00000100:00100000:1.0:1769074920.886829:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626614784 00000100:00100000:0.0:1769074920.886850:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615040 00000100:00100000:0.0:1769074920.886860:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615040 00000100:00100000:0.0:1769074920.886923:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615552 00000100:00100000:1.0:1769074920.886923:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1769074920.886932:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615552 00000100:00100000:1.0:1769074920.886934:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626614784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1769074920.886972:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 57344 granted 484937536 pending 0 free 3915657216 avail 3684134912 00000100:00100000:0.0:1769074920.886974:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626616064 00000100:00100000:0.0:1769074920.886982:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626616064 00000100:00100000:0.0:1769074920.887001:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615424 00000100:00100000:0.0:1769074920.887006:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615424 00000100:00100000:1.0:1769074920.887032:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626614784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074920.887033:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615296 00000100:00100000:0.0:1769074920.887044:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615296 00000100:00100000:1.0:1769074920.887045:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1769074920.887074:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:1.0:1769074920.887087:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615936 00000100:00100000:1.0:1769074920.887092:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615936 00000100:00100000:1.0:1769074920.887112:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615808 00000100:00100000:1.0:1769074920.887114:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615808 00000100:00100000:1.0:1769074920.887129:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:1.0:1769074920.887133:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626615936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.887157:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626615936:12345-0@lo:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.887161:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:1.0:1769074920.887167:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1769074920.887170:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626615808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.887187:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626615808:12345-0@lo:400:kworker.0 Request processed in 16us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.887192:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1769074920.887245:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626614528 00000100:00100000:1.0:1769074920.887250:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626614528 00000100:00100000:1.0:1769074920.887271:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626614656 00000100:00100000:1.0:1769074920.887273:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626614656 00000100:00100000:1.0:1769074920.887283:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1769074920.887287:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626614528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1769074920.887313:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446223872 avail 1299984384 00000100:00100000:1.0:1769074920.887337:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626614528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.887341:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1769074920.887348:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1769074920.887352:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626614656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1769074920.887364:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:1.0:1769074920.887391:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626614656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 29us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.887395:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1769074920.887407:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1855007626615040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.887419:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1769074920.887427:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626615552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074920.887565:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:2.0:1769074920.887573:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1855007626616064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890009:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626615552:12345-0@lo:400:kworker.0 Request processed in 2568us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.890028:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1769074920.890082:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:1.0:1769074920.890102:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1855007626615424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890190:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1855007626615424:12345-0@lo:400:kworker.0 Request processed in 101us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.890196:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:1.0:1769074920.890209:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:1.0:1769074920.890216:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1855007626615296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890262:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1855007626615296:12345-0@lo:400:kworker.0 Request processed in 47us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.890269:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00080000:1.0:1769074920.890333:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1769074920.890341:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769074920.890345:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1769074920.890348:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074920.890823:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1855007626615296:0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890845:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626615808:0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890858:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1855007626615424:0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890873:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626615936:0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.890887:0:3657:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967843 gen 2 00000100:00100000:1.0:1769074920.890915:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626614784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769074920.891111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.891141:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056448 00000100:00100000:1.0:1769074920.891150:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056448 00000100:00100000:1.0:1769074920.891194:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00100000:1.0:1769074920.891201:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616056448:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074920.891279:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.891307:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8be3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c40 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.892900:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074920.892929:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.892943:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.892963:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074920.892969:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.892976:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893049:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893056:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893063:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893072:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.893077:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893084:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893098:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.893101:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.893107:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893113:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8bea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893130:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893136:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893141:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893145:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.893148:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893153:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893159:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604ec78000) 00010000:00010000:1.0:1769074920.893162:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.893165:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.893170:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8bf1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.894235:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8be3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c40 expref: 313 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.894255:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.894258:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074920.894262:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8be3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c40 expref: 313 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.894275:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7e00, rc -2) 00000100:00100000:1.0:1769074920.894405:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616056448:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3200us (3294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074920.894418:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00100000:2.0:1769074920.896865:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1855007626616064:12345-0@lo:400:kworker.0 Request processed in 9275us (10496us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074920.896885:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:3.0:1769074920.900164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074920.900264:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626615680:0@lo:400:kworker.0 00000100:00100000:0.0:1769074920.900289:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1855007626615040:12345-0@lo:400:kworker.0 Request processed in 13196us (13987us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074920.900307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1769074920.900344:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074920.900351:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615168 00000100:00100000:0.0:1769074920.900362:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615168 00000100:00080000:0.0:1769074920.900429:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1769074920.900494:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:1.0:1769074920.900505:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626615680 00000100:00100000:0.0:1769074920.900506:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626615168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.900517:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626615680 00000100:00100000:1.0:1769074920.900588:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1769074920.900597:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626615680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.900655:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626615680:12345-0@lo:400:kworker.0 Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.900663:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:0.0:1769074920.900775:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626615168:12345-0@lo:400:kworker.0 Request processed in 270us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074920.900786:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1769074920.900985:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967854 gen 2 00000100:00100000:3.0:1769074920.901009:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626615680:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.901025:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1855007626615040:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.901039:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626615552:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.901053:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1855007626616064:0@lo:400:kworker.0 00000100:00100000:3.0:1769074920.901076:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626614656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1769074920.901092:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626614528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1769074920.901130:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626615168:0@lo:400:kworker.0 00000100:00100000:1.0:1769074920.905646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.905760:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056576 00000100:00100000:3.0:1769074920.905775:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056576 00000100:00100000:3.0:1769074920.905874:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9272 00000100:00100000:3.0:1769074920.905885:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67255:x1855007616056576:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074920.905916:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.905948:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bf8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c78 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.906049:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.906067:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906081:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906099:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.906105:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906111:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906196:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906205:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906227:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906235:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906241:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.906247:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906254:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906268:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.906271:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.906276:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906283:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe8bff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906301:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906307:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906312:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906317:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.906320:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906325:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906332:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604e0be900) 00010000:00010000:3.0:1769074920.906336:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.906339:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.906349:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe8c06 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.907154:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bf8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c78 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.907172:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.907174:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.907178:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe8bf8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c78 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.907204:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:3.0:1769074920.907304:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67255:x1855007616056576:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1419us (1674us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.907313:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9272 00000100:00100000:1.0:1769074920.917242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.917320:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056704 00000100:00100000:3.0:1769074920.917333:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056704 00000100:00100000:3.0:1769074920.917415:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9273 00000100:00100000:3.0:1769074920.917425:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67256:x1855007616056704:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074920.917454:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.917484:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c0d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c7f expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.917618:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.917635:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917654:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917668:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.917675:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917681:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917755:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917761:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917767:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917774:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917779:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.917784:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917791:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917805:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.917809:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.917815:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917821:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c14 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917835:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917841:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917847:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917851:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.917854:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917859:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917865:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604e0be900) 00010000:00010000:3.0:1769074920.917867:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.917870:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917875:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c1b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.917906:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c0d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c7f expref: 313 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.917917:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.917920:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.917924:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c7f expref: 313 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.917932:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42200, rc 0) 00000100:00100000:3.0:1769074920.918001:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67256:x1855007616056704:12345-192.168.204.32@tcp:101:rm.0 Request processed in 578us (792us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.918009:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9273 00000100:00100000:3.0:1769074920.920692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074920.920995:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056960 00000100:00100000:0.0:1769074920.921010:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056960 00000100:00100000:1.0:1769074920.921165:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.921191:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616056832 00000100:00100000:1.0:1769074920.921196:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616056832 00000100:00100000:0.0:1769074920.921341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9274 00000100:00100000:0.0:1769074920.921354:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67256:x1855007616056960:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074920.921392:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074920.921421:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8c22 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29cbe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.921554:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074920.921575:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921589:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921608:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074920.921615:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921622:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921719:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921728:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921735:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921747:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.921752:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921760:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921775:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.921778:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.921784:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921791:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe8c29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921806:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921812:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921818:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921823:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074920.921826:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921831:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921839:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604f3c6000) 00010000:00010000:0.0:1769074920.921841:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.921845:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921851:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe8c30 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074920.921889:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8c22 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29cbe expref: 314 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.921900:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074920.921903:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074920.921907:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe8c22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29cbe expref: 314 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074920.921917:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15000, rc 0) 00000100:00100000:0.0:1769074920.921990:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:67256:x1855007616056960:12345-192.168.204.32@tcp:101:rm.0 Request processed in 638us (1312us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074920.921999:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9274 00000100:00100000:1.0:1769074920.922156:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 130 00000100:00100000:1.0:1769074920.922167:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2418:x1855007616056832:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074920.922233:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.922244:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8c37 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29c86 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.922281:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.922291:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922301:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922315:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074920.922322:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922328:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922361:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922368:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922375:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922385:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.922389:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922396:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922405:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.922407:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.922410:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922414:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8c3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922423:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922429:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922435:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922441:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.922444:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922451:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922458:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604ec78000) 00010000:00010000:1.0:1769074920.922460:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.922464:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922470:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8c45 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074920.922492:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8c37 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c86 expref: 313 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.922501:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.922503:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074920.922506:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8c37 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29c86 expref: 313 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.922517:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc -2) 00000100:00100000:1.0:1769074920.922581:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2418:x1855007616056832:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 417us (1417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074920.922590:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 130 00000100:00100000:2.0:1769074920.953112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.953249:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057216 00000100:00100000:1.0:1769074920.953265:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057216 00000100:00100000:1.0:1769074920.953344:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 131 00000100:00100000:1.0:1769074920.953357:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616057216:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074920.953864:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.953893:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8c4c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ccc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.953978:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074920.953997:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954012:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954031:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074920.954038:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954044:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954115:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954123:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954131:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954137:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.954143:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954152:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954168:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.954171:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.954177:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954184:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8c53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954201:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954208:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954233:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954238:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.954241:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954248:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954255:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604ec78000) 00010000:00010000:1.0:1769074920.954257:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.954260:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954266:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8c5a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074920.954302:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8c4c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ccc expref: 313 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.954313:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.954314:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074920.954318:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8c4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ccc expref: 313 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.954333:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc -2) 00000100:00100000:1.0:1769074920.957164:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616057216:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3795us (4055us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074920.957179:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 131 00000100:00100000:0.0:1769074920.957444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.958023:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057088 00000100:00100000:1.0:1769074920.958036:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057088 00000100:00100000:1.0:1769074920.958081:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9275 00000100:00100000:1.0:1769074920.958087:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67259:x1855007616057088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.958109:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.958133:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8c61 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29cc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.958211:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074920.958240:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958254:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958271:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074920.958276:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958280:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958355:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958360:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958365:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958369:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.958385:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958391:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958400:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.958403:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.958407:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958412:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8c68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958424:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958427:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958430:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958433:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074920.958436:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958439:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958443:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604ec78a00) 00010000:00010000:1.0:1769074920.958444:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.958445:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958448:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8c6f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074920.958479:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8c61 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29cc5 expref: 313 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.958486:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074920.958487:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074920.958489:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8c61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29cc5 expref: 313 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074920.958494:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75800, rc 0) 00000100:00100000:1.0:1769074920.958572:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67259:x1855007616057088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 485us (1129us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074920.958577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9275 00000100:00100000:0.0:1769074920.964141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.964257:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057344 00000100:00100000:3.0:1769074920.964275:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057344 00000100:00100000:3.0:1769074920.964350:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9276 00000100:00100000:3.0:1769074920.964360:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67259:x1855007616057344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.964394:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.964422:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d04 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.964506:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.964524:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964570:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964585:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074920.964592:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964602:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964670:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964677:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964683:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964690:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964702:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.964707:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964715:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964729:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.964733:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.964738:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964744:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe8c7d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964760:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964766:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964772:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964776:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d42800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074920.964779:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964784:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964790:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604e0be900) 00010000:00010000:3.0:1769074920.964793:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.964795:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964800:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42800/0x557988ac98fe8c84 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074920.964839:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c76 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d04 expref: 313 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.964850:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074920.964852:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074920.964855:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d42200/0x557988ac98fe8c76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d04 expref: 313 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.964863:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42200, rc 0) 00000100:00100000:3.0:1769074920.964939:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67259:x1855007616057344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 580us (813us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074920.964947:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9276 00000100:00100000:2.0:1769074920.971682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.976233:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057600 00000100:00100000:1.0:1769074920.976259:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057600 00000100:00100000:1.0:1769074920.976365:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9277 00000100:00100000:2.0:1769074920.976804:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:67259:x1855007616057600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074920.976835:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074920.976867:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe8c8b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d0b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.977032:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074920.977052:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.977072:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.977091:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x9392a964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074920.977099:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.977106:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:2.0:1769074920.977929:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa9:0x0], index 0: 0 00010000:00010000:2.0:1769074920.978144:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ca0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074920.978158:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ca0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978168:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ca0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978229:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978237:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978244:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978251:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074920.978256:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978265:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978280:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074920.978283:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074920.978289:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978294:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8c92 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:2.0:1769074920.978308:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000072b88507 reply state 000000005d9ebcd2 transno 4294968980 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978320:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074920.978325:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604f4dfd00) 00010000:00010000:2.0:1769074920.978327:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074920.978330:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074920.980246:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe8c8b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d0b expref: 315 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.980299:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adac00/0x557988ac98fe8ca0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d0b expref: 314 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074920.980311:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15c:0x0].0x0 (ffff91604f4df100) 00010000:00010000:2.0:1769074920.980314:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074920.980317:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adac00, rc 0) 00000100:00100000:2.0:1769074920.980442:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+315:67259:x1855007616057600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4065us (8774us total) trans 4294968980 rc 0/0 00000100:00100000:2.0:1769074920.980457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9277 00000100:00100000:3.0:1769074920.984948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074920.988747:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057728 00000100:00100000:1.0:1769074920.988771:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057728 00000100:00100000:1.0:1769074920.988878:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2667 00000100:00100000:1.0:1769074920.988892:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2420:x1855007616057728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074920.988917:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074920.988946:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d12 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074920.988980:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074920.989006:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.989009:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074920.989020:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 149 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.989046:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 149 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074920.989063:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75800, rc 0) 00000100:00100000:1.0:1769074920.989169:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2420:x1855007616057728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 279us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074920.989177:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2667 00000100:00100000:0.0:1769074920.995717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074920.996555:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057856 00000100:00100000:3.0:1769074920.996572:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057856 00000100:00100000:3.0:1769074920.996723:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2668 00000100:00100000:3.0:1769074920.996735:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:67259:x1855007616057856:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074920.996767:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074920.996792:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d19 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.996849:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.996858:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.996861:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074920.996865:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d19 expref: 150 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074920.996907:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074920.996923:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:3.0:1769074920.996940:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626616192:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074920.997086:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1769074921.000932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.001622:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626616192:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074921.001670:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d19 expref: 150 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.001698:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42200, rc 0) 00000100:00100000:3.0:1769074921.001782:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:67259:x1855007616057856:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5048us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074921.001793:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2668 00000100:00100000:2.0:1769074921.001967:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616057984 00000100:00100000:2.0:1769074921.001977:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616057984 00010000:00010000:2.0:1769074921.002065:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074921.002108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1862 00000100:00100000:2.0:1769074921.002119:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2420:x1855007616057984:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074921.002140:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074921.002166:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.002180:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.002211:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052a75800/0x557988ac98fe8cae lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d12 expref: 150 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.002236:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.002239:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.002248:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d19 expref: 149 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.002259:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d19 expref: 149 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.002305:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916042d42200/0x557988ac98fe8cb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d19 expref: 149 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074921.002327:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626616320:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074921.002403:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd540 going to sleep for 11 seconds 00000100:00080000:1.0:1769074921.003210:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074921.012269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.012675:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058240 00000100:00100000:3.0:1769074921.012688:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058240 00000100:00100000:3.0:1769074921.012783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1847 00000100:00100000:3.0:1769074921.012807:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+315:67259:x1855007616058240:12345-192.168.204.32@tcp:35:cp.0 00000100:00080000:1.0:1769074921.012938:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074921.013774:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67259:x1855007616058240:12345-192.168.204.32@tcp:35:cp.0 Request processed in 974us (1512us total) trans 4294968981 rc 0/0 00000100:00100000:3.0:1769074921.013785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1847 00000100:00100000:0.0:1769074921.014074:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626616320:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074921.014103:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074921.014134:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2420:x1855007616057984:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12017us (13219us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.014144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1862 00000100:00100000:0.0:1769074921.045502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.045689:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058368 00000100:00100000:1.0:1769074921.045704:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058368 00000100:00100000:1.0:1769074921.045771:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 132 00000100:00100000:1.0:1769074921.045782:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:2419:x1855007616058368:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074921.045861:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.045888:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8cbc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d20 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.045963:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074921.045982:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.045995:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046010:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074921.046017:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046023:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046101:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046109:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046115:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046121:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.046125:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046133:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046151:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.046155:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.046160:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046167:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8cc3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046182:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046188:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046192:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046197:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.046200:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046204:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046211:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604ec78b00) 00010000:00010000:1.0:1769074921.046213:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.046216:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046230:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8cca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074921.046263:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8cbc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d20 expref: 317 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.046273:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.046276:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074921.046279:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8cbc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d20 expref: 317 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.046288:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74600, rc -2) 00000100:00100000:1.0:1769074921.046387:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:2419:x1855007616058368:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 605us (899us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074921.046396:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 132 00000100:00100000:2.0:1769074921.053440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.053577:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058496 00000100:00100000:0.0:1769074921.053592:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058496 00000100:00100000:0.0:1769074921.053683:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9278 00000100:00100000:0.0:1769074921.053695:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67266:x1855007616058496:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074921.053723:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.053750:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cd1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.053852:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.053872:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053885:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053902:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.053909:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053916:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053980:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053988:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.053996:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054007:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.054012:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054021:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054034:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.054038:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.054044:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054050:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8cd8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054063:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054068:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054072:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054077:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.054079:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054084:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054090:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604f3c6000) 00010000:00010000:0.0:1769074921.054092:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.054096:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054101:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8cdf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.054143:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cd1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d58 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.054153:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.054155:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.054159:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cd1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d58 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.054169:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14000, rc 0) 00000100:00100000:0.0:1769074921.054261:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67266:x1855007616058496:12345-192.168.204.32@tcp:101:bash.0 Request processed in 567us (836us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.054270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9278 00000100:00080000:1.0:1769074921.054361:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074921.077967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.078024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.078157:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058752 00000100:00100000:2.0:1769074921.078170:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058752 00000100:00100000:2.0:1769074921.078267:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00100000:2.0:1769074921.078279:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:2419:x1855007616058752:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074921.078333:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.078361:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8ce6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d5f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.078852:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.078872:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.078885:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.078903:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.078910:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.078918:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.078995:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079003:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079009:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079016:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.079021:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079030:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079044:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.079048:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.079054:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079061:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8ced lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079077:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079083:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079089:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079094:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.079097:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079104:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079111:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.079114:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.079117:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079122:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8cf4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.079156:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8ce6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d5f expref: 317 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.079167:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.079170:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1769074921.079305:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058624 00000100:00100000:0.0:1769074921.079313:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058624 00010000:00010000:2.0:1769074921.079651:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8ce6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d5f expref: 318 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.079667:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc -2) 00000100:00100000:2.0:1769074921.079766:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+317:2419:x1855007616058752:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1488us (1812us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074921.079776:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00100000:0.0:1769074921.080084:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9279 00000100:00100000:0.0:1769074921.080100:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67267:x1855007616058624:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074921.080120:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.080138:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cfb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d66 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.080214:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.080237:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080248:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080263:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.080270:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080276:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080323:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080331:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080338:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080345:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080351:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.080355:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080362:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080389:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.080392:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.080397:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080404:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe8d02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080415:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080421:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080426:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080432:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.080435:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080441:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080448:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604f3c6000) 00010000:00010000:0.0:1769074921.080450:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.080452:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080459:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8d09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.080489:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cfb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d66 expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.080497:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.080500:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.080503:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8cfb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d66 expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.080511:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14000, rc 0) 00000100:00100000:0.0:1769074921.080585:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67267:x1855007616058624:12345-192.168.204.32@tcp:101:rm.0 Request processed in 489us (2559us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.085753:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9279 00000100:00100000:3.0:1769074921.087011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.087256:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616058880 00000100:00100000:0.0:1769074921.087271:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616058880 00000100:00100000:0.0:1769074921.087335:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9280 00000100:00100000:0.0:1769074921.087347:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67267:x1855007616058880:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074921.087377:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.087420:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d6d expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.087517:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.087563:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087578:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087595:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.087603:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087610:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087682:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087690:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087697:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087703:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087711:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.087716:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087724:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087738:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.087741:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.087746:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087752:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d17 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087767:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087773:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087779:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087786:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.087789:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087794:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087801:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604f3c6300) 00010000:00010000:0.0:1769074921.087804:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.087807:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087812:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.087863:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d10 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d6d expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.087874:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.087877:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.087880:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d6d expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.087889:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074921.087973:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67267:x1855007616058880:12345-192.168.204.32@tcp:101:rm.0 Request processed in 628us (973us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.087981:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9280 00000100:00100000:2.0:1769074921.111659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.112098:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059008 00000100:00100000:1.0:1769074921.112112:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059008 00000100:00100000:1.0:1769074921.112267:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9281 00000100:00100000:1.0:1769074921.112281:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67268:x1855007616059008:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.112311:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.112344:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8d25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.112466:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.112484:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112497:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112514:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.112522:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112528:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112662:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112670:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112678:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112686:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.112690:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112698:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112713:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.112717:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.112723:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112730:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d2c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112750:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112757:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112764:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112769:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.112772:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112778:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112786:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604ec78b00) 00010000:00010000:1.0:1769074921.112789:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.112792:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112797:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.112851:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8d25 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d74 expref: 317 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.112863:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.112866:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.112870:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8d25 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d74 expref: 317 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.112880:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74600, rc 0) 00000100:00100000:1.0:1769074921.112981:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67268:x1855007616059008:12345-192.168.204.32@tcp:101:cp.0 Request processed in 702us (1338us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.112989:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9281 00000100:00100000:3.0:1769074921.124272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.125418:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059136 00000100:00100000:0.0:1769074921.125438:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059136 00000100:00100000:0.0:1769074921.125571:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9282 00000100:00100000:0.0:1769074921.125583:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67268:x1855007616059136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.125612:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.125640:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d3a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d7b expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.125731:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.125750:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125762:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125778:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074921.125785:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125791:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125865:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125873:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125879:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125886:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125894:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.125899:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125908:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125937:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.125941:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.125948:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125954:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8d41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125971:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125979:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125986:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.125992:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.125994:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.126000:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.126007:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604f3c6300) 00010000:00010000:0.0:1769074921.126010:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.126013:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.126017:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8d48 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074921.126055:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d3a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d7b expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.126065:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.126068:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.126071:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8d3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d7b expref: 317 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.126081:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074921.126175:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67268:x1855007616059136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 594us (1918us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.126185:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9282 00000100:00100000:3.0:1769074921.139139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.139267:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059392 00000100:00100000:1.0:1769074921.139282:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059392 00000100:00100000:1.0:1769074921.139360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9283 00000100:00100000:1.0:1769074921.139382:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:67268:x1855007616059392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.139411:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.139439:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8d4f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.139635:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.139653:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.139667:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.139683:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3427451a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.139690:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.139696:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:1.0:1769074921.140096:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xaa:0x0], index 1: 0 00010000:00010000:1.0:1769074921.140319:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8d64 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.140330:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8d64 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140338:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8d64 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140377:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140384:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140391:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140397:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.140401:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140409:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140422:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.140425:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.140429:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140435:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8d56 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:1.0:1769074921.140449:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000083a35d8a reply state 000000008c08967a transno 4294968982 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140460:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.140465:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604ec78b00) 00010000:00010000:1.0:1769074921.140467:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074921.140471:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074921.140505:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8d4f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d82 expref: 319 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.140519:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75800/0x557988ac98fe8d64 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d82 expref: 318 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.140527:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15d:0x0].0x0 (ffff91604f3d4b00) 00010000:00010000:1.0:1769074921.141667:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074921.141674:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75800, rc 0) 00000100:00100000:0.0:1769074921.142711:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+319:67268:x1855007616059392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3332us (3576us total) trans 4294968982 rc 0/0 00000100:00100000:0.0:1769074921.142724:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9283 00000100:00100000:0.0:1769074921.147078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.147264:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059520 00000100:00100000:3.0:1769074921.147278:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059520 00000100:00100000:3.0:1769074921.147422:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2669 00000100:00100000:3.0:1769074921.147434:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+147:2419:x1855007616059520:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074921.147458:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.147486:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d89 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074921.147517:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074921.147581:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.147584:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.147595:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 148 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.147616:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 148 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.147632:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42800, rc 0) 00000100:00100000:3.0:1769074921.147703:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2419:x1855007616059520:12345-192.168.204.32@tcp:101:cp.0 Request processed in 270us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074921.147711:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2669 00000100:00080000:1.0:1769074921.149100:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074921.154818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.155033:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059648 00000100:00100000:2.0:1769074921.155047:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059648 00000100:00100000:2.0:1769074921.155158:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2670 00000100:00100000:2.0:1769074921.155171:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:67268:x1855007616059648:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.155206:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.155241:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d90 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.155288:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 149 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074921.155297:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.155299:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.155304:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d90 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.155352:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 149 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074921.155381:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 149 pid: 24564 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074921.155400:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626616448:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074921.155679:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbda80 going to sleep for 11 seconds 00000100:00100000:0.0:1769074921.165844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.165957:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616059776 00000100:00100000:1.0:1769074921.165970:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616059776 00010000:00010000:1.0:1769074921.166046:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00000100:00100000:1.0:1769074921.166094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1863 00000100:00100000:1.0:1769074921.166104:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2420:x1855007616059776:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074921.166122:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074921.166149:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00010000:00010000:1.0:1769074921.166165:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00010000:00010000:1.0:1769074921.166197:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.166199:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.166208:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d90 expref: 150 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.166234:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d90 expref: 150 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.166287:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d90 expref: 150 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074921.166304:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149864e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626616576:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074921.166430:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9d80 going to sleep for 11 seconds 00010000:00010000:2.0:1769074921.167635:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916042d42800/0x557988ac98fe8d72 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d89 expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074921.167661:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626616448:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074921.167695:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f499400/0x557988ac98fe8d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d90 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.167709:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499400, rc 0) 00000100:00100000:2.0:1769074921.167827:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:67268:x1855007616059648:12345-192.168.204.32@tcp:101:cp.0 Request processed in 12656us (13023us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074921.167846:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2670 00000100:00100000:1.0:1769074921.173017:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149864e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626616576:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074921.173056:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074921.173143:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2420:x1855007616059776:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7039us (7315us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074921.173156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1863 00000100:00100000:0.0:1769074921.182650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.182764:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060032 00000100:00100000:3.0:1769074921.182779:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060032 00000100:00100000:3.0:1769074921.182860:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1848 00000100:00100000:3.0:1769074921.182872:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916148472050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+319:67268:x1855007616060032:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074921.183305:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916148472050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67268:x1855007616060032:12345-192.168.204.32@tcp:35:cp.0 Request processed in 433us (668us total) trans 4294968983 rc 0/0 00000100:00100000:3.0:1769074921.183315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1848 00000100:00100000:0.0:1769074921.226588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.226855:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060160 00000100:00100000:2.0:1769074921.226869:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060160 00000100:00100000:2.0:1769074921.226942:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 134 00000100:00100000:2.0:1769074921.226955:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:2420:x1855007616060160:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074921.227036:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.227063:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d80 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29d97 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.227137:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.227155:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227169:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227184:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.227191:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227198:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227299:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227308:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227315:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227322:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.227327:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227335:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227350:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.227355:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.227361:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227367:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8d87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227980:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227990:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.227996:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.228001:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.228006:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.228012:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.228022:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f4df700) 00010000:00010000:2.0:1769074921.228025:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.228028:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.228034:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d8e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.228077:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d80 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d97 expref: 321 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.228088:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.228090:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074921.228094:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29d97 expref: 321 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.228104:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f498400, rc -2) 00000100:00100000:2.0:1769074921.228203:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:2420:x1855007616060160:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1249us (1681us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074921.228214:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 134 00000100:00100000:0.0:1769074921.239207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.239337:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060288 00000100:00100000:2.0:1769074921.239352:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060288 00000100:00100000:2.0:1769074921.239443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9284 00000100:00100000:2.0:1769074921.239455:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67273:x1855007616060288:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074921.239486:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.239810:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29dcf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.239929:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.239950:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.239964:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.239980:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.239987:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.239993:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240065:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240073:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240081:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240087:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.240092:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240104:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240119:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.240123:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.240130:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240136:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8d9c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240155:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240161:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240167:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240172:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.240174:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240180:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240187:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.240189:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.240192:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.240197:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8da3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.241263:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d95 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29dcf expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.241283:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.241287:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.241291:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8d95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29dcf expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.241307:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f498400, rc 0) 00000100:00100000:2.0:1769074921.241423:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67273:x1855007616060288:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1968us (2232us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.241433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9284 00000100:00100000:1.0:1769074921.251365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.251489:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060544 00000100:00100000:2.0:1769074921.251515:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060544 00000100:00100000:2.0:1769074921.251615:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 135 00000100:00100000:2.0:1769074921.251628:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:2420:x1855007616060544:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074921.251685:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.251716:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8daa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ddd expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.251797:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.251815:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251841:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251864:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.251872:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251878:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251952:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251960:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251967:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251973:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.251977:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251985:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.251998:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.252002:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.252008:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252013:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8db1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252028:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252035:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252041:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252045:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a36000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.252047:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252052:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252057:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604f4df600) 00010000:00010000:2.0:1769074921.252060:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.252062:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252068:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8db8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.252102:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8daa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ddd expref: 321 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.252112:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.252114:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074921.252118:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8daa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ddd expref: 321 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.252128:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc -2) 00000100:00100000:2.0:1769074921.252239:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:2420:x1855007616060544:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 605us (885us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074921.252251:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 135 00000100:00100000:3.0:1769074921.257617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.257919:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060416 00000100:00100000:2.0:1769074921.257934:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060416 00000100:00100000:2.0:1769074921.258012:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9285 00000100:00100000:2.0:1769074921.258025:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67274:x1855007616060416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074921.258053:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.258084:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8dbf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.258174:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.258193:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258204:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258231:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.258237:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258243:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258311:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258318:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258325:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258331:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.258336:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258343:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258357:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.258360:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.258366:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258372:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8dc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258387:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258393:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258398:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258403:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.258406:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258411:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258422:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4df900) 00010000:00010000:2.0:1769074921.258424:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.258427:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258432:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8dcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.258471:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8dbf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29dd6 expref: 321 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.258482:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.258484:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.258488:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8dbf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29dd6 expref: 321 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.258509:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074921.258689:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67274:x1855007616060416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 666us (1087us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.258699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9285 00000100:00100000:3.0:1769074921.265294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.265424:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060672 00000100:00100000:0.0:1769074921.265440:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060672 00000100:00100000:0.0:1769074921.265577:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9286 00000100:00100000:0.0:1769074921.265591:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67274:x1855007616060672:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074921.265624:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.265653:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8dd4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29de4 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.265754:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074921.265773:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265786:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265801:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074921.265808:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265814:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265882:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265890:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265897:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265905:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265912:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.265917:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265926:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265942:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.265946:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.265953:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265960:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe8ddb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265977:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265983:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265990:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.265996:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.265999:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.266005:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.266013:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f3c6300) 00010000:00010000:0.0:1769074921.266016:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.266020:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.266031:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe8de2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074921.266069:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8dd4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29de4 expref: 321 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.266078:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.266080:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.266084:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe8dd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29de4 expref: 321 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.266093:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074921.266182:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67274:x1855007616060672:12345-192.168.204.32@tcp:101:rm.0 Request processed in 593us (904us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.266191:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9286 00000100:00100000:1.0:1769074921.283697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.283821:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060800 00000100:00100000:2.0:1769074921.283846:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060800 00000100:00100000:2.0:1769074921.283916:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9287 00000100:00100000:2.0:1769074921.283927:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67275:x1855007616060800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.283960:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.283990:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8de9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29deb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.284095:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.284116:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284131:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284146:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.284152:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284157:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284242:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284250:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284257:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284264:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.284269:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284279:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284300:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.284304:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.284311:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284318:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8df0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284334:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284340:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284346:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284352:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.284355:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284361:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284368:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4df900) 00010000:00010000:2.0:1769074921.284371:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.284375:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284381:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8df7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.284422:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8de9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29deb expref: 321 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.284433:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.284436:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.284439:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8de9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29deb expref: 321 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.284450:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074921.284595:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67275:x1855007616060800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 668us (916us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.284604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9287 00000100:00100000:3.0:1769074921.287457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.288231:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616060928 00000100:00100000:0.0:1769074921.288248:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616060928 00000100:00100000:1.0:1769074921.292173:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9288 00000100:00100000:1.0:1769074921.292193:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67275:x1855007616060928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.292233:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.292265:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8dfe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29df2 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.292361:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.292393:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292407:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292426:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.292433:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292438:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292518:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292525:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292550:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292557:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292563:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.292568:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292576:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292591:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.292594:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.292601:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292607:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8e05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292624:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292630:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292634:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292639:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.292641:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292646:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292653:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f3d4c00) 00010000:00010000:1.0:1769074921.292655:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.292658:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292663:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8e0c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.292700:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8dfe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29df2 expref: 321 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.292711:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.292714:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.292718:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8dfe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29df2 expref: 321 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.292727:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:3.0:1769074921.295975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.296065:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67275:x1855007616060928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 637us (5383us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.296079:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9288 00000100:00100000:1.0:1769074921.297204:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061184 00000100:00100000:1.0:1769074921.297229:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061184 00000100:00100000:2.0:1769074921.297307:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9289 00000100:00100000:2.0:1769074921.297321:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67275:x1855007616061184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.297349:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.297620:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8e13 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29df9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.298124:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.298143:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.298156:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.298171:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.298178:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.298185:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:2.0:1769074921.299166:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xaa:0x0], index 0: 0 00010000:00010000:2.0:1769074921.299872:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8e28 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.299892:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8e28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299912:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8e28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299960:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299968:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299975:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299982:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.299987:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.299995:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.300009:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.300012:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.300019:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.300030:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e1a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:2.0:1769074921.300046:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000079f7f5c9 reply state 0000000021e6e392 transno 4294968984 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.300058:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.300064:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4df900) 00010000:00010000:2.0:1769074921.300066:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074921.300070:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074921.300117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8e13 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29df9 expref: 323 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.300134:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a36000/0x557988ac98fe8e28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29df9 expref: 322 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.300142:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15e:0x0].0x0 (ffff91604f4df600) 00010000:00010000:2.0:1769074921.300144:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074921.300147:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a36000, rc 0) 00000100:00100000:2.0:1769074921.300264:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+323:67275:x1855007616061184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2944us (4300us total) trans 4294968984 rc 0/0 00000100:00100000:2.0:1769074921.300274:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9289 00000100:00100000:3.0:1769074921.304524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.304611:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061312 00000100:00100000:3.0:1769074921.304625:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061312 00000100:00100000:3.0:1769074921.304691:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2671 00000100:00100000:3.0:1769074921.304703:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2417:x1855007616061312:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074921.304728:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.304753:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e00 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074921.304784:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074921.304809:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.304811:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.304822:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 150 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.304853:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 150 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.304868:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc 0) 00000100:00100000:3.0:1769074921.304944:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2417:x1855007616061312:12345-192.168.204.32@tcp:101:cp.0 Request processed in 242us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074921.304952:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2671 00000100:00100000:3.0:1769074921.308495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.308575:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061440 00000100:00100000:3.0:1769074921.308588:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061440 00000100:00100000:3.0:1769074921.308651:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2672 00000100:00100000:3.0:1769074921.308662:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:67275:x1855007616061440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074921.308686:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.308709:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e07 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.308754:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.308764:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.308767:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.308772:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e07 expref: 151 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.308818:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.308848:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 151 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:3.0:1769074921.308865:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626616704:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074921.308990:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a180 going to sleep for 11 seconds 00000100:00100000:1.0:1769074921.313724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.314054:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061568 00000100:00100000:2.0:1769074921.314069:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061568 00010000:00010000:2.0:1769074921.314147:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 152 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074921.314194:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1864 00000100:00100000:2.0:1769074921.314205:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2420:x1855007616061568:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074921.314236:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074921.314262:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 152 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.314280:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 152 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.314315:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.314317:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.314326:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e07 expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.314338:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e07 expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.314400:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e07 expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074921.314417:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626616832:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074921.314553:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbd540 going to sleep for 11 seconds 00010000:00010000:0.0:1769074921.316138:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916042d43800/0x557988ac98fe8e36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e00 expref: 152 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:0.0:1769074921.316163:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626616704:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074921.316204:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916042d42800/0x557988ac98fe8e3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e07 expref: 151 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.316705:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d42800, rc 0) 00000100:00100000:0.0:1769074921.316801:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:67275:x1855007616061440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 8138us (8320us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.316815:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2672 00000100:00100000:2.0:1769074921.320865:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626616832:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074921.320903:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074921.320976:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2420:x1855007616061568:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6772us (7269us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074921.320990:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1864 00000100:00100000:3.0:1769074921.324790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.324945:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061824 00000100:00100000:2.0:1769074921.324959:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061824 00000100:00100000:2.0:1769074921.325025:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1849 00000100:00100000:2.0:1769074921.325035:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+323:67275:x1855007616061824:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074921.325451:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67275:x1855007616061824:12345-192.168.204.32@tcp:35:cp.0 Request processed in 414us (672us total) trans 4294968985 rc 0/0 00000100:00100000:2.0:1769074921.325460:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1849 00000100:00100000:1.0:1769074921.369749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.369971:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616061952 00000100:00100000:2.0:1769074921.369985:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616061952 00000100:00100000:2.0:1769074921.370065:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9290 00000100:00100000:2.0:1769074921.370077:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67278:x1855007616061952:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074921.370105:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.370134:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8e44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e0e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.370230:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.370247:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370259:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370276:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.370287:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370293:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370359:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370367:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370373:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370380:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.370384:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370392:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370407:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.370410:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.370415:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370421:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8e4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370435:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370440:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370446:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370451:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.370453:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370459:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370464:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.370467:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.370469:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370474:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.370519:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8e44 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e0e expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.370856:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.370860:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.370866:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8e44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e0e expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.370877:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074921.370959:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67278:x1855007616061952:12345-192.168.204.32@tcp:101:bash.0 Request processed in 884us (1226us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.370968:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9290 00000100:00100000:1.0:1769074921.391839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.391901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.392015:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062080 00000100:00100000:2.0:1769074921.392029:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062080 00000100:00100000:2.0:1769074921.392107:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9291 00000100:00100000:2.0:1769074921.392119:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67279:x1855007616062080:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074921.392156:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.392185:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e59 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e15 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.392292:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.392313:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392326:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392344:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.392352:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392359:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392436:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392443:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392449:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392457:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.392462:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392470:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392484:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.392488:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.392506:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392512:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8e60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392528:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392593:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392599:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392604:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.392607:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392612:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392620:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.392622:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.392626:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392631:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8e67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.392672:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e59 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e15 expref: 325 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.392684:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.392686:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.392689:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8e59 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e15 expref: 325 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.392698:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc 0) 00000100:00100000:2.0:1769074921.392777:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67279:x1855007616062080:12345-192.168.204.32@tcp:101:rm.0 Request processed in 660us (964us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.392785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9291 00000100:00100000:3.0:1769074921.394035:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062208 00000100:00100000:3.0:1769074921.394051:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062208 00000100:00100000:3.0:1769074921.394113:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 136 00000100:00100000:3.0:1769074921.394123:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:2417:x1855007616062208:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074921.394163:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.394183:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8e6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e1c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.394257:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074921.394274:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394284:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394301:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074921.394307:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394312:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394392:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394399:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394406:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394412:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.394415:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394423:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394435:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.394439:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.394444:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394449:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe8e75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394463:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394469:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394475:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394479:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.394481:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394487:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394851:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff916052a0cb00) 00010000:00010000:3.0:1769074921.394854:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.394858:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394864:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe8e7c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074921.394902:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8e6e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e1c expref: 325 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.394911:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.394914:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074921.394919:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe8e6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e1c expref: 325 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.394929:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc -2) 00000100:00100000:3.0:1769074921.395021:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:2417:x1855007616062208:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 898us (3118us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074921.395033:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 136 00000100:00100000:0.0:1769074921.402204:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626617088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074921.402318:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074921.402443:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626617088 00000100:00100000:0.0:1769074921.402453:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626617088 00000100:00100000:0.0:1769074921.402526:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1769074921.402561:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626617088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1769074921.402593:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 57344 granted 484937536 pending 0 free 3915657216 avail 3684134912 00000100:00100000:0.0:1769074921.402649:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626617088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.402658:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1769074921.402719:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626617088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1769074921.404253:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626616960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1769074921.404341:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074921.404692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.405075:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062336 00000100:00100000:3.0:1769074921.405088:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062336 00000100:00100000:3.0:1769074921.405165:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9292 00000100:00100000:3.0:1769074921.405176:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67279:x1855007616062336:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074921.405203:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.405241:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe8e83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e23 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.405336:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074921.405356:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405385:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405403:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074921.405415:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405421:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405816:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405898:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405905:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405911:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405917:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.405922:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405930:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405946:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.405950:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.405956:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405963:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405980:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405986:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405991:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.405996:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.405999:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.406004:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.406010:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff916052a0c700) 00010000:00010000:3.0:1769074921.406013:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.406016:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.406021:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.406065:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe8e83 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e23 expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.406076:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.406078:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.406082:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe8e83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e23 expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.406093:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc 0) 00000100:00100000:3.0:1769074921.406174:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67279:x1855007616062336:12345-192.168.204.32@tcp:101:rm.0 Request processed in 998us (1483us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074921.406184:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9292 00000100:00100000:0.0:1769074921.410524:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626616960 00000100:00100000:0.0:1769074921.410572:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626616960 00000100:00100000:0.0:1769074921.410656:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1769074921.410669:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626616960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1769074921.410717:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484937536 pending 0 free 3764449280 avail 3532926976 00000100:00100000:0.0:1769074921.410963:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626616960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 296us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.410973:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1769074921.411054:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626616960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769074921.423146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.423256:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062464 00000100:00100000:3.0:1769074921.423271:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062464 00000100:00100000:3.0:1769074921.423349:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9293 00000100:00100000:3.0:1769074921.423361:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67280:x1855007616062464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074921.423401:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.423430:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e98 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e2a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.423583:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074921.423609:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423623:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423641:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074921.423648:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423655:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423726:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423734:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423742:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423750:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423757:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.423762:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423771:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423786:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.423789:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.423795:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423802:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe8e9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.423818:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425114:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425124:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425131:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074921.425135:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425147:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425164:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff916052a0c700) 00010000:00010000:3.0:1769074921.425167:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.425172:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425179:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe8ea6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074921.425258:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e98 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e2a expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.425270:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074921.425273:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074921.425277:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe8e98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e2a expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.425288:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:2.0:1769074921.425502:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67280:x1855007616062464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2129us (2357us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.425514:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9293 00000100:00100000:1.0:1769074921.437781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.438019:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062592 00000100:00100000:2.0:1769074921.438034:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062592 00000100:00100000:2.0:1769074921.438115:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9294 00000100:00100000:2.0:1769074921.438128:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67280:x1855007616062592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.438159:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.438187:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ead lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e31 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.438297:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.438316:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438331:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438346:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.438354:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438360:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438430:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438438:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438445:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438452:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438458:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.438463:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438476:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438726:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.438731:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.438739:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438746:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8eb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438765:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438771:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438776:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438781:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.438784:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438789:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438797:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.438800:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.438803:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.438809:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ebb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.439051:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ead lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e31 expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.439065:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.439067:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.439072:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ead lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e31 expref: 325 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.439083:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc 0) 00000100:00100000:2.0:1769074921.439235:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67280:x1855007616062592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1107us (1471us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.439244:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9294 00000100:00100000:3.0:1769074921.446271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.446416:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062848 00000100:00100000:2.0:1769074921.446432:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062848 00000100:00100000:2.0:1769074921.446520:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9295 00000100:00100000:2.0:1769074921.446575:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67280:x1855007616062848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.446604:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.446632:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ec2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e38 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.446820:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.446839:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.446853:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.446874:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x95382be7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.446880:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.446887:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074921.447336:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xab:0x0], index 1: 0 00010000:00010000:2.0:1769074921.447583:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8ed7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x15f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.447596:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8ed7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447604:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8ed7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447650:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447658:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447665:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447672:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447678:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.447682:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447691:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447705:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.447708:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.447714:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447720:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8ec9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074921.447737:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000013dee92b reply state 00000000e023e533 transno 4294968986 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447748:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.447753:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4df700) 00010000:00010000:2.0:1769074921.447755:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074921.447759:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074921.447803:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ec2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e38 expref: 327 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.447819:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498800/0x557988ac98fe8ed7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e38 expref: 326 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.447827:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x15f:0x0].0x0 (ffff91604f4df500) 00010000:00010000:2.0:1769074921.447829:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074921.447832:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f498800, rc 0) 00000100:00100000:2.0:1769074921.447947:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+327:67280:x1855007616062848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1416us (1693us total) trans 4294968986 rc 0/0 00000100:00100000:2.0:1769074921.447961:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9295 00000100:00100000:1.0:1769074921.473963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.474078:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616062976 00000100:00100000:0.0:1769074921.474093:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616062976 00000100:00100000:0.0:1769074921.474168:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2673 00000100:00100000:0.0:1769074921.474181:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+148:2418:x1855007616062976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.474209:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.474246:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e3f expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074921.474279:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074921.474306:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.474309:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.474322:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 149 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.474343:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 149 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.474360:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:0.0:1769074921.474452:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2418:x1855007616062976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 273us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.474461:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2673 00000100:00100000:1.0:1769074921.485504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.485669:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063104 00000100:00100000:3.0:1769074921.485684:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063104 00000100:00100000:3.0:1769074921.485816:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2674 00000100:00100000:3.0:1769074921.485836:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:67280:x1855007616063104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074921.485859:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074921.485885:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e46 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.485929:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.485937:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.485939:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074921.485944:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e46 expref: 150 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.485991:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074921.486009:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00000100:00100000:3.0:1769074921.486026:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626617216:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074921.486164:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a180 going to sleep for 11 seconds 00000100:00100000:3.0:1769074921.490887:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626617216:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074921.490941:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e46 expref: 150 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074921.490966:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7e00, rc 0) 00000100:00100000:3.0:1769074921.491050:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:67280:x1855007616063104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5224us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074921.491061:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2674 00000100:00100000:0.0:1769074921.491675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.491782:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063232 00000100:00100000:2.0:1769074921.491793:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063232 00010000:00010000:2.0:1769074921.491963:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00000100:00100000:2.0:1769074921.492045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1865 00000100:00100000:2.0:1769074921.492056:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2419:x1855007616063232:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074921.492074:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074921.492099:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.492114:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.492143:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fe8ee5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e3f expref: 150 pid: 24564 timeout: 2010 lvb_type: 1 00010000:00010000:2.0:1769074921.492162:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.492164:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.492173:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e46 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.492184:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e46 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.492255:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7e00/0x557988ac98fe8eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e46 expref: 149 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074921.492272:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626617344:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074921.492359:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1769074921.510063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074921.510523:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063488 00000100:00100000:3.0:1769074921.510609:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063488 00000100:00100000:3.0:1769074921.510689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1850 00000100:00100000:3.0:1769074921.510700:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+327:67280:x1855007616063488:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074921.511095:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67280:x1855007616063488:12345-192.168.204.32@tcp:35:cp.0 Request processed in 395us (1047us total) trans 4294968987 rc 0/0 00000100:00100000:3.0:1769074921.511103:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1850 00000100:00100000:2.0:1769074921.511524:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626617344:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074921.511589:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074921.511628:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2419:x1855007616063232:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 19573us (19956us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074921.511649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1865 00000100:00100000:1.0:1769074921.542754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.542858:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063616 00000100:00100000:2.0:1769074921.542873:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063616 00000100:00100000:2.0:1769074921.542954:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 137 00000100:00100000:2.0:1769074921.542967:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:2417:x1855007616063616:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074921.543031:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.543058:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ef3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e4d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.543135:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.543154:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543168:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543191:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.543198:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543205:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543293:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543301:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543309:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543316:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.543320:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543329:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543343:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.543347:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.543352:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543358:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8efa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543385:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543392:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543399:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543404:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.543407:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543414:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543421:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604f4df300) 00010000:00010000:2.0:1769074921.543424:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.543427:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543433:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f01 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.543466:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ef3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e4d expref: 329 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.543477:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.543480:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074921.543483:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8ef3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e4d expref: 329 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.543492:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc -2) 00000100:00100000:2.0:1769074921.543643:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:2417:x1855007616063616:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 678us (904us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074921.543653:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 137 00000100:00100000:3.0:1769074921.564258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.564665:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063744 00000100:00100000:1.0:1769074921.564680:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063744 00000100:00100000:1.0:1769074921.564758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9296 00000100:00100000:1.0:1769074921.564769:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67284:x1855007616063744:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074921.564796:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.564831:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.564921:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.564939:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.564951:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.564968:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.564974:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.564980:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565044:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565051:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565057:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565063:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.565067:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565075:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565093:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.565097:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.565102:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565108:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565122:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565128:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565133:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565138:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.565141:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565146:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565152:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f3d4c00) 00010000:00010000:1.0:1769074921.565154:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.565156:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565161:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.565193:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f08 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e54 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.565204:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.565206:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.565220:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e54 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.565230:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074921.565305:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67284:x1855007616063744:12345-192.168.204.32@tcp:101:bash.0 Request processed in 538us (1063us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.565313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9296 00000100:00100000:1.0:1769074921.578327:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.578450:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616063872 00000100:00100000:2.0:1769074921.578465:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616063872 00000100:00100000:2.0:1769074921.578601:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9297 00000100:00100000:2.0:1769074921.578615:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67285:x1855007616063872:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074921.578645:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.578675:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f1d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e5b expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.578768:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.578786:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578801:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578818:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.578836:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578843:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578912:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578919:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578926:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578933:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578939:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.578943:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578951:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578965:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.578968:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.578974:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578981:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.578997:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579002:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579008:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579011:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.579014:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579024:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579030:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f4df300) 00010000:00010000:2.0:1769074921.579032:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.579035:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579040:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f2b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.579077:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f1d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e5b expref: 329 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.579088:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.579091:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.579094:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e5b expref: 329 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.579103:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc 0) 00000100:00100000:2.0:1769074921.579189:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67285:x1855007616063872:12345-192.168.204.32@tcp:101:rm.0 Request processed in 576us (876us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.579196:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9297 00000100:00100000:3.0:1769074921.579996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.580155:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064000 00000100:00100000:0.0:1769074921.580164:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064000 00000100:00100000:0.0:1769074921.580239:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 138 00000100:00100000:0.0:1769074921.580250:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:2417:x1855007616064000:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074921.580301:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.580322:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8f32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e62 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.580386:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.580402:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580413:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580429:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.580436:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580443:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580519:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580527:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580562:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580568:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.580573:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580580:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580593:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.580596:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.580601:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580608:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe8f39 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580622:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580628:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580633:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580637:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.580640:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580645:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580651:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f3c6500) 00010000:00010000:0.0:1769074921.580654:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.580657:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580662:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15a00/0x557988ac98fe8f40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.580690:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8f32 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e62 expref: 329 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.580698:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.580701:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074921.580705:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe8f32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e62 expref: 329 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.580713:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc -2) 00000100:00100000:0.0:1769074921.580787:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:2417:x1855007616064000:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 539us (798us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074921.580796:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 138 00000100:00100000:3.0:1769074921.583151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.586117:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064128 00000100:00100000:1.0:1769074921.586144:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064128 00000100:00100000:1.0:1769074921.586748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9298 00000100:00100000:1.0:1769074921.586767:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67285:x1855007616064128:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074921.586797:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.586838:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e69 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.586933:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.586952:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.586966:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.586984:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.586992:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.586999:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587072:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587079:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587086:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587092:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.587098:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587105:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587118:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.587122:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.587128:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587133:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8f4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587150:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587156:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587162:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587167:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.587170:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587176:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587183:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f3d4c00) 00010000:00010000:1.0:1769074921.587186:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.587188:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587193:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f55 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.587244:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f47 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e69 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.587254:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.587257:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.587260:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e69 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.587270:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74600, rc 0) 00000100:00100000:1.0:1769074921.590083:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67285:x1855007616064128:12345-192.168.204.32@tcp:101:rm.0 Request processed in 612us (4234us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.590100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9298 00000100:00100000:1.0:1769074921.602473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.602809:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064256 00000100:00100000:2.0:1769074921.602824:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064256 00000100:00100000:2.0:1769074921.602904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9299 00000100:00100000:2.0:1769074921.602916:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67286:x1855007616064256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.602944:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.602975:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e70 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.603073:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.603090:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603105:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603121:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.603129:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603136:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603207:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603227:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603235:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603241:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.603246:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603254:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603270:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.603273:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.603279:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603285:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fe8f63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603301:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603307:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603312:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603316:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.603319:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603325:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603331:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f4df300) 00010000:00010000:2.0:1769074921.603333:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.603336:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603341:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98fe8f6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.603699:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f5c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e70 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.603713:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.603716:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.603720:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fe8f5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e70 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.603732:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc 0) 00000100:00100000:2.0:1769074921.603818:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67286:x1855007616064256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 903us (1363us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.603828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9299 00000100:00100000:3.0:1769074921.606979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.607078:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064384 00000100:00100000:2.0:1769074921.607092:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064384 00000100:00100000:2.0:1769074921.607170:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9300 00000100:00100000:2.0:1769074921.607182:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67286:x1855007616064384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.607219:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.607247:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8f71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e77 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.607345:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.607364:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607388:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607434:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074921.607446:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607452:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607520:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607568:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607577:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607584:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.607589:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607597:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607611:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.607614:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.607620:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607626:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fe8f78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607641:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607647:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607654:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607659:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.607662:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607667:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607673:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f4df000) 00010000:00010000:2.0:1769074921.607675:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.607677:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607682:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe8f7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074921.607717:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8f71 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e77 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.607729:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.607731:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.607734:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fe8f71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e77 expref: 329 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.607743:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074921.607821:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67286:x1855007616064384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 641us (856us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.607830:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9300 00000100:00100000:3.0:1769074921.612608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.612774:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064640 00000100:00100000:1.0:1769074921.612789:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064640 00000100:00100000:1.0:1769074921.612876:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9301 00000100:00100000:1.0:1769074921.612888:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67286:x1855007616064640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.612916:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.612943:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f86 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e7e expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.613106:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.613125:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613138:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613155:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xac9be172 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.613161:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613167:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:1.0:1769074921.613631:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xab:0x0], index 0: 0 00010000:00010000:1.0:1769074921.613821:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f9b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x160:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.613833:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f9b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613846:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f9b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613888:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613896:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613902:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613910:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613916:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.613921:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613929:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613942:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.613946:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.613952:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613958:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8f8d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:1.0:1769074921.613974:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b8fcea25 reply state 0000000009736492 transno 4294968988 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613985:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.613992:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f3d4c00) 00010000:00010000:1.0:1769074921.613995:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074921.613998:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074921.614036:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8f86 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e7e expref: 331 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.614053:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74600/0x557988ac98fe8f9b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x160:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e7e expref: 330 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.614061:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x160:0x0].0x0 (ffff91604f3d4200) 00010000:00010000:1.0:1769074921.614063:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074921.614066:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74600, rc 0) 00000100:00100000:1.0:1769074921.614166:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:67286:x1855007616064640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1278us (1571us total) trans 4294968988 rc 0/0 00000100:00100000:1.0:1769074921.614177:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9301 00000100:00100000:3.0:1769074921.617884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.618137:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064768 00000100:00100000:1.0:1769074921.618152:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064768 00000100:00100000:1.0:1769074921.618236:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2675 00000100:00100000:1.0:1769074921.618249:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2419:x1855007616064768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.618274:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.618301:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e85 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074921.618331:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074921.618359:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.618361:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.618380:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.618398:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.618411:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074921.618472:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2419:x1855007616064768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 227us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074921.618478:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2675 00000100:00100000:3.0:1769074921.622009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.622416:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616064896 00000100:00100000:0.0:1769074921.622431:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616064896 00000100:00100000:0.0:1769074921.622517:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2676 00000100:00100000:0.0:1769074921.622566:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:67286:x1855007616064896:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.622592:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.622618:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e8c expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.622661:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.622669:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.622670:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.622674:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e8c expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.622713:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.622727:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 152 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:0.0:1769074921.622741:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626617472:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074921.622871:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617fac5900 going to sleep for 11 seconds 00000100:00100000:2.0:1769074921.626339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.626455:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065024 00000100:00100000:1.0:1769074921.626468:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065024 00010000:00010000:1.0:1769074921.626588:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 153 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:1.0:1769074921.626639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1866 00000100:00100000:1.0:1769074921.626648:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2420:x1855007616065024:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074921.626665:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074921.626688:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 153 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:1.0:1769074921.626701:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 153 pid: 25313 timeout: 2010 lvb_type: 1 00010000:00010000:1.0:1769074921.626728:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.626730:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.626737:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e8c expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.626749:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e8c expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.626786:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e8c expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074921.626797:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626617600:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074921.626908:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f93c0 going to sleep for 11 seconds 00010000:00010000:0.0:1769074921.627728:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe8fa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e85 expref: 153 pid: 25313 timeout: 2010 lvb_type: 1 00000100:00100000:0.0:1769074921.627746:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626617472:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074921.627772:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b15a00/0x557988ac98fe8fb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e8c expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.627782:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15a00, rc 0) 00000100:00100000:0.0:1769074921.627846:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:67286:x1855007616064896:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5318us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.627856:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2676 00000100:00100000:1.0:1769074921.630980:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626617600:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074921.631012:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074921.631086:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2420:x1855007616065024:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4438us (4761us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074921.631099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1866 00000100:00100000:3.0:1769074921.634808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.635082:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065280 00000100:00100000:1.0:1769074921.635097:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065280 00000100:00100000:1.0:1769074921.635175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1851 00000100:00100000:1.0:1769074921.635186:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+331:67286:x1855007616065280:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074921.635913:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67286:x1855007616065280:12345-192.168.204.32@tcp:35:cp.0 Request processed in 724us (1115us total) trans 4294968989 rc 0/0 00000100:00100000:1.0:1769074921.635924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1851 00010000:00010000:0.0:1769074921.652984:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074921.676076:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.676192:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065408 00000100:00100000:1.0:1769074921.676238:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065408 00000100:00100000:1.0:1769074921.676318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9302 00000100:00100000:1.0:1769074921.676330:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67289:x1855007616065408:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074921.676362:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.676404:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fb7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e93 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.676508:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.676604:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676619:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676660:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.676669:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676676:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676748:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676756:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676762:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676769:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.676773:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676786:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676800:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.676803:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.676809:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.676815:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fbe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677262:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677269:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677275:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677281:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.677284:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677290:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677299:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3d4400) 00010000:00010000:1.0:1769074921.677302:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.677306:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677311:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fc5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.677357:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fb7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e93 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.677380:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.677383:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.677388:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fb7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e93 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.677397:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:0.0:1769074921.677675:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67289:x1855007616065408:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1344us (1615us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.677684:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9302 00000100:00100000:2.0:1769074921.694901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.695021:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065536 00000100:00100000:1.0:1769074921.695035:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065536 00000100:00100000:1.0:1769074921.695114:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9303 00000100:00100000:1.0:1769074921.695125:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67290:x1855007616065536:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074921.695158:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.695184:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fcc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29e9a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.695287:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.695306:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695318:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695335:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.695341:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695349:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695432:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695440:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695446:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695454:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695461:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.695466:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695475:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695501:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.695505:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.695512:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695518:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe8fd3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695581:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695588:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695596:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695602:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.695605:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695611:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695618:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3d4400) 00010000:00010000:1.0:1769074921.695621:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.695624:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695630:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe8fda lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.695670:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fcc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e9a expref: 333 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.695682:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.695684:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.695688:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe8fcc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29e9a expref: 333 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.695697:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074921.695769:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67290:x1855007616065536:12345-192.168.204.32@tcp:101:rm.0 Request processed in 645us (957us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.695776:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9303 00000100:00100000:3.0:1769074921.702404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.702592:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065664 00000100:00100000:2.0:1769074921.702606:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065664 00000100:00100000:2.0:1769074921.702684:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 139 00000100:00100000:2.0:1769074921.702696:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:2419:x1855007616065664:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074921.702750:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.702777:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe8fe1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ea1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.702870:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.702888:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.702901:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.702918:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074921.702925:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.702931:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703001:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703010:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703018:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703024:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.703028:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703037:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703050:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.703054:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.703059:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703066:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe8fe8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703080:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703085:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703090:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703095:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.703097:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703103:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703113:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f4df000) 00010000:00010000:2.0:1769074921.703115:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.703118:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703124:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe8fef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074921.703159:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe8fe1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ea1 expref: 333 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.703169:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.703171:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074921.703175:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe8fe1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ea1 expref: 333 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.703184:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc -2) 00000100:00100000:2.0:1769074921.703290:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:2419:x1855007616065664:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 596us (901us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074921.703299:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 139 00000100:00100000:2.0:1769074921.706645:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.706742:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065792 00000100:00100000:1.0:1769074921.706757:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065792 00000100:00100000:1.0:1769074921.706840:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9304 00000100:00100000:1.0:1769074921.706851:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67290:x1855007616065792:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074921.706880:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.706936:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe8ff6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ea8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.707021:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.707040:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707054:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707070:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.707077:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707084:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707149:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707157:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707164:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707173:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.707178:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707186:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707200:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.707204:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.707219:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707226:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe8ffd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707247:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707253:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707258:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707263:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.707265:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707271:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707278:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3d4e00) 00010000:00010000:1.0:1769074921.707280:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.707283:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707288:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9004 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.707329:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe8ff6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ea8 expref: 333 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.707339:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.707342:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.707345:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe8ff6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ea8 expref: 333 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.707356:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094400, rc 0) 00000100:00100000:1.0:1769074921.707440:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67290:x1855007616065792:12345-192.168.204.32@tcp:101:rm.0 Request processed in 590us (809us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.707448:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9304 00000100:00100000:3.0:1769074921.722722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.722902:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616065920 00000100:00100000:2.0:1769074921.722916:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616065920 00000100:00100000:2.0:1769074921.722987:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9305 00000100:00100000:2.0:1769074921.722996:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67291:x1855007616065920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074921.723022:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.723045:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe900b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29eaf expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.723134:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.723152:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723166:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723182:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.723189:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723195:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723273:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723280:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723286:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723292:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723298:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.723303:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723316:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723329:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.723332:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.723336:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723343:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9012 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723358:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723364:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723370:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723375:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.723377:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723382:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723388:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f4df000) 00010000:00010000:2.0:1769074921.723390:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.723393:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723398:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe9019 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.723431:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe900b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eaf expref: 333 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.723442:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.723444:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.723448:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe900b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eaf expref: 333 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.723456:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074921.723639:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67291:x1855007616065920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 643us (931us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.723647:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9305 00000100:00100000:3.0:1769074921.730687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.730917:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066048 00000100:00100000:1.0:1769074921.730933:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066048 00000100:00100000:1.0:1769074921.731016:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9306 00000100:00100000:1.0:1769074921.731028:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67291:x1855007616066048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.731061:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.731093:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe9020 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29eb6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.731194:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.731225:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731241:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731259:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074921.731265:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731272:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731340:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731349:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731356:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731363:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.731379:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731388:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731402:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.731406:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.731412:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731419:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9027 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731439:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731446:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731451:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731456:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.731459:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731465:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731473:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3d4e00) 00010000:00010000:1.0:1769074921.731476:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.731479:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731484:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe902e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074921.731916:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe9020 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eb6 expref: 333 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.731930:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.731933:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.731937:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094400/0x557988ac98fe9020 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eb6 expref: 333 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.731954:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094400, rc 0) 00000100:00100000:0.0:1769074921.732114:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67291:x1855007616066048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1086us (1444us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.732124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9306 00000100:00100000:3.0:1769074921.736642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.736793:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066304 00000100:00100000:0.0:1769074921.736809:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066304 00000100:00100000:0.0:1769074921.736892:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9307 00000100:00100000:0.0:1769074921.736905:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67291:x1855007616066304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.736935:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.736964:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe9035 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ebd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.737123:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.737144:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737158:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737174:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xea63b32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.737181:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737188:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:0.0:1769074921.737654:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xac:0x0], index 1: 0 00010000:00010000:0.0:1769074921.737849:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe904a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x161:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.737860:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe904a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737868:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe904a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737913:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737924:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737930:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737935:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.737940:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737947:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737960:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.737964:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.737970:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737975:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe903c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:0.0:1769074921.737989:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001aa6e590 reply state 00000000bf47747d transno 4294968990 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.737999:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.738005:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3c6500) 00010000:00010000:0.0:1769074921.738008:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074921.738011:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074921.738050:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe9035 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ebd expref: 335 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.738071:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15200/0x557988ac98fe904a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ebd expref: 334 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.738078:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x161:0x0].0x0 (ffff91604f3c6900) 00010000:00010000:0.0:1769074921.738081:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074921.738084:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15200, rc 0) 00000100:00100000:0.0:1769074921.738171:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+335:67291:x1855007616066304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1268us (1542us total) trans 4294968990 rc 0/0 00000100:00100000:0.0:1769074921.738180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9307 00000100:00100000:3.0:1769074921.743276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.743390:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066432 00000100:00100000:0.0:1769074921.743405:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066432 00000100:00100000:0.0:1769074921.743486:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2677 00000100:00100000:0.0:1769074921.743509:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+149:2419:x1855007616066432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.743582:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.743613:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ec4 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074921.743644:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074921.743676:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.743679:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.743691:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 150 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.743713:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 150 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.743737:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074921.743811:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2419:x1855007616066432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 304us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.743829:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2677 00000100:00100000:3.0:1769074921.747642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.747832:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066560 00000100:00100000:1.0:1769074921.747846:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066560 00000100:00100000:1.0:1769074921.747916:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2678 00000100:00100000:1.0:1769074921.747926:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:67291:x1855007616066560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.747951:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.747975:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ecb expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.748016:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 151 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.748025:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.748027:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.748031:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ecb expref: 151 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.748078:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 151 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.748095:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 151 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:1.0:1769074921.748112:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626617728:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074921.748249:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074921.751996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.752119:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066688 00000100:00100000:2.0:1769074921.752132:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066688 00010000:00010000:2.0:1769074921.752216:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 152 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:2.0:1769074921.752265:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1867 00000100:00100000:2.0:1769074921.752276:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2419:x1855007616066688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074921.752296:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074921.752323:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 152 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074921.752340:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 152 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074921.752393:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.752395:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.752405:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ecb expref: 152 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.752416:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ecb expref: 152 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.752465:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ecb expref: 152 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074921.752482:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626617856:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074921.752643:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2600 going to sleep for 11 seconds 00010000:00010000:1.0:1769074921.753311:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052b14c00/0x557988ac98fe9058 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ec4 expref: 152 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:1.0:1769074921.753332:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626617728:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074921.753362:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e094400/0x557988ac98fe905f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ecb expref: 151 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.753384:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094400, rc 0) 00000100:00100000:1.0:1769074921.753436:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:67291:x1855007616066560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5511us (5812us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074921.753446:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2678 00000100:00100000:3.0:1769074921.759035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.759121:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616066944 00000100:00100000:1.0:1769074921.759133:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616066944 00000100:00100000:1.0:1769074921.759202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1852 00000100:00100000:1.0:1769074921.759224:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+335:67291:x1855007616066944:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074921.759652:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67291:x1855007616066944:12345-192.168.204.32@tcp:35:cp.0 Request processed in 429us (631us total) trans 4294968991 rc 0/0 00000100:00100000:1.0:1769074921.759662:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1852 00000100:00100000:2.0:1769074921.760107:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626617856:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074921.760136:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074921.760182:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2419:x1855007616066688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7907us (8202us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074921.760193:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1867 00000100:00100000:3.0:1769074921.795954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.796150:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067072 00000100:00100000:2.0:1769074921.796167:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067072 00000100:00100000:2.0:1769074921.796310:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9308 00000100:00100000:2.0:1769074921.796322:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67294:x1855007616067072:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074921.796353:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074921.796391:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9066 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ed2 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.796504:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.796522:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796578:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796596:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074921.796602:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796608:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796690:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796697:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796703:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796710:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796717:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.796721:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796733:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796747:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.796750:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.796755:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796760:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe906d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796775:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796780:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796785:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796790:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074921.796793:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796797:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796804:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f4df000) 00010000:00010000:2.0:1769074921.796807:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.796810:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796815:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe9074 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074921.796853:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9066 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ed2 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.796863:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074921.796866:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074921.796869:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9066 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ed2 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.796877:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074921.796963:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67294:x1855007616067072:12345-192.168.204.32@tcp:101:bash.0 Request processed in 642us (1025us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074921.796971:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9308 00000100:00100000:2.0:1769074921.811518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.811788:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067200 00000100:00100000:0.0:1769074921.811803:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067200 00000100:00100000:0.0:1769074921.811890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9309 00000100:00100000:0.0:1769074921.811902:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67295:x1855007616067200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074921.811935:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.811964:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe907b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ed9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.812062:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.812080:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812094:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812112:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.812120:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812127:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812215:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812224:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812230:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812237:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.812242:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812250:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812265:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.812269:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.812275:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe9082 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812298:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812305:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812311:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812317:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.812321:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812327:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812334:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3c6100) 00010000:00010000:0.0:1769074921.812337:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.812340:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812346:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9089 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.812399:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe907b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ed9 expref: 337 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.812410:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.812413:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.812417:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe907b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ed9 expref: 337 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.812427:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14600, rc 0) 00000100:00100000:0.0:1769074921.812514:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67295:x1855007616067200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 614us (1023us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.812523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9309 00000100:00100000:3.0:1769074921.817882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.818713:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067328 00000100:00100000:0.0:1769074921.818731:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067328 00000100:00100000:0.0:1769074921.818990:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 140 00000100:00100000:0.0:1769074921.819004:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:2417:x1855007616067328:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074921.819056:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.819083:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe9090 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ee0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.819161:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.819180:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.819193:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823075:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.823108:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823122:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823216:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823225:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823232:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823239:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.823243:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823257:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823271:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.823274:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.823280:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823286:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9097 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823306:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823312:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823318:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823322:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.823325:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823331:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823337:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604f3c6100) 00010000:00010000:0.0:1769074921.823339:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.823342:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823347:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe909e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.823410:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe9090 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ee0 expref: 337 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.823420:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.823423:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074921.823427:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe9090 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ee0 expref: 337 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.823436:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14600, rc -2) 00000100:00100000:0.0:1769074921.823611:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:2417:x1855007616067328:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 4609us (5743us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074921.823623:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 140 00000100:00100000:3.0:1769074921.827290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.827520:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067456 00000100:00100000:1.0:1769074921.827578:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067456 00000100:00100000:1.0:1769074921.827656:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9310 00000100:00100000:1.0:1769074921.827669:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67295:x1855007616067456:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074921.827700:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.827731:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ee7 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.827969:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.827989:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828002:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828018:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.828026:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828032:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828105:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828113:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828119:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828125:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828131:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.828135:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828143:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828161:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.828165:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.828171:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828177:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828198:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828215:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828222:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828227:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.828230:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828236:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828243:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3d4e00) 00010000:00010000:1.0:1769074921.828245:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.828248:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828253:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90b3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.828293:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90a5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ee7 expref: 337 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.828305:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.828307:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.828311:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ee7 expref: 337 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.828320:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094c00, rc 0) 00000100:00100000:1.0:1769074921.828749:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67295:x1855007616067456:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1080us (1943us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.828758:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9310 00000100:00100000:3.0:1769074921.851275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.851438:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067584 00000100:00100000:0.0:1769074921.851454:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067584 00000100:00100000:0.0:1769074921.851601:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9311 00000100:00100000:0.0:1769074921.851615:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67296:x1855007616067584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.851645:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.851675:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe90ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29eee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.851769:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.851791:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851806:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851828:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.851834:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851840:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851905:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851914:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851921:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851928:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.851933:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851942:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851956:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.851959:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.851965:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851971:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851988:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.851995:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852001:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852007:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.852009:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852015:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852021:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3c6100) 00010000:00010000:0.0:1769074921.852023:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.852026:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852031:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.852076:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe90ba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eee expref: 337 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.852088:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.852091:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.852095:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe90ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29eee expref: 337 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.852105:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14600, rc 0) 00000100:00100000:0.0:1769074921.852188:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67296:x1855007616067584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 576us (929us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.852197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9311 00000100:00100000:3.0:1769074921.859448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.859696:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067712 00000100:00100000:1.0:1769074921.859712:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067712 00000100:00100000:1.0:1769074921.859793:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9312 00000100:00100000:1.0:1769074921.859810:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67296:x1855007616067712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.859850:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.859880:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29ef5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.859980:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.859999:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860011:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860028:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.860038:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860045:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860118:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860125:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860132:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860139:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860146:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.860151:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860158:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860172:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.860176:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.860182:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860187:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe90d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860216:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860223:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860228:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860233:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.860236:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860242:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860249:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3d4e00) 00010000:00010000:1.0:1769074921.860251:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.860254:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860259:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe90dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.860296:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90cf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ef5 expref: 337 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.860305:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.860308:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.860311:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe90cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29ef5 expref: 337 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.860321:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094c00, rc 0) 00000100:00100000:1.0:1769074921.860424:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67296:x1855007616067712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 615us (991us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.860432:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9312 00000100:00100000:3.0:1769074921.872955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.873069:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616067968 00000100:00100000:0.0:1769074921.873083:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616067968 00000100:00100000:0.0:1769074921.873156:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9313 00000100:00100000:0.0:1769074921.873167:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67296:x1855007616067968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.873195:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.873231:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe90e4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29efc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.873387:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.873406:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.873420:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.873436:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.873442:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.873449:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:0.0:1769074921.873934:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xac:0x0], index 0: 0 00010000:00010000:0.0:1769074921.874107:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe90f9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x162:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.874117:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe90f9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874126:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe90f9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874161:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874168:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874175:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874181:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.874185:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874193:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874217:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.874221:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.874227:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe90eb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:0.0:1769074921.874246:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ee9349ab reply state 0000000049822a55 transno 4294968992 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874257:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.874262:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3c6100) 00010000:00010000:0.0:1769074921.874265:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074921.874268:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074921.874303:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14600/0x557988ac98fe90e4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29efc expref: 339 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.874317:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14200/0x557988ac98fe90f9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29efc expref: 338 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.874324:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x162:0x0].0x0 (ffff91604f3c6d00) 00010000:00010000:0.0:1769074921.874327:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074921.874329:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14200, rc 0) 00000100:00100000:0.0:1769074921.874420:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:67296:x1855007616067968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1253us (1478us total) trans 4294968992 rc 0/0 00000100:00100000:0.0:1769074921.874430:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9313 00000100:00100000:3.0:1769074921.890931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.891242:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068096 00000100:00100000:1.0:1769074921.891257:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068096 00000100:00100000:1.0:1769074921.891336:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2679 00000100:00100000:1.0:1769074921.891349:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2417:x1855007616068096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074921.891386:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.891415:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f03 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074921.891448:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074921.891476:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.891478:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074921.891490:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.891510:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074921.891525:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094c00, rc 0) 00000100:00100000:1.0:1769074921.891660:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2417:x1855007616068096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 314us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074921.891667:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2679 00000100:00100000:3.0:1769074921.902377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.902581:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068224 00000100:00100000:0.0:1769074921.902594:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068224 00000100:00100000:0.0:1769074921.902658:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2680 00000100:00100000:0.0:1769074921.902668:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:67296:x1855007616068224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074921.902700:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.902725:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f0a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.902763:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.902773:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.902775:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074921.902780:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f0a expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.902841:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074921.902858:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:0.0:1769074921.902875:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626617984:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074921.903007:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160452e76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074921.907869:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626617984:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074921.907925:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f0a expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.907954:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14600, rc 0) 00000100:00100000:0.0:1769074921.908057:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:67296:x1855007616068224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5388us (5702us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074921.908068:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2680 00000100:00100000:3.0:1769074921.910326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.910450:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068352 00000100:00100000:2.0:1769074921.910463:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068352 00010000:00010000:2.0:1769074921.910595:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:2.0:1769074921.910644:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1868 00000100:00100000:2.0:1769074921.910655:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2419:x1855007616068352:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074921.910674:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074921.910702:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074921.910719:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074921.910757:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e094c00/0x557988ac98fe9107 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f03 expref: 153 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074921.910781:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.910783:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074921.910791:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f0a expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.910803:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f0a expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074921.910863:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052b14600/0x557988ac98fe910e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f0a expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074921.910881:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626618112:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074921.910989:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604419cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074921.915597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074921.915739:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626618112:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074921.915769:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074921.915857:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2419:x1855007616068352:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5202us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074921.915869:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1868 00000100:00100000:0.0:1769074921.916296:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068608 00000100:00100000:0.0:1769074921.916306:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068608 00000100:00100000:0.0:1769074921.916361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1853 00000100:00100000:0.0:1769074921.916371:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+339:67296:x1855007616068608:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074921.916756:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67296:x1855007616068608:12345-192.168.204.32@tcp:35:cp.0 Request processed in 385us (1175us total) trans 4294968993 rc 0/0 00000100:00100000:0.0:1769074921.916765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1853 00000100:00100000:3.0:1769074921.957357:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074921.957605:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068736 00000100:00100000:1.0:1769074921.957619:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068736 00000100:00100000:1.0:1769074921.957690:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9314 00000100:00100000:1.0:1769074921.957702:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67299:x1855007616068736:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074921.957733:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074921.957760:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9115 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f11 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.957861:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.957881:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.957894:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.957912:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074921.957918:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.957924:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958000:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958007:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958013:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958020:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958027:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.958033:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958041:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958055:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.958059:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.958064:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958070:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe911c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958091:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958098:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958103:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958109:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074921.958112:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958117:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958124:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3d4f00) 00010000:00010000:1.0:1769074921.958127:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.958129:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958138:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9123 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074921.958176:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9115 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f11 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.958187:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074921.958189:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074921.958193:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9115 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f11 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074921.958213:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074921.958295:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67299:x1855007616068736:12345-192.168.204.32@tcp:101:bash.0 Request processed in 594us (952us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074921.958303:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9314 00000100:00100000:3.0:1769074921.976047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.979628:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068864 00000100:00100000:0.0:1769074921.979654:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068864 00000100:00100000:0.0:1769074921.979753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9315 00000100:00100000:0.0:1769074921.979766:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67300:x1855007616068864:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074921.979806:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.979837:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe912a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.979932:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.979951:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.979964:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.979982:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074921.979988:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.979993:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980065:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980073:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980079:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980090:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.980094:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980102:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980116:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.980120:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.980125:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980131:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9131 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980147:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980153:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980159:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980164:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.980167:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980173:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980179:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074921.980182:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.980185:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980190:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9138 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074921.980252:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe912a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f18 expref: 341 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.980262:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.980265:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.980268:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe912a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f18 expref: 341 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.980278:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074921.980383:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67300:x1855007616068864:12345-192.168.204.32@tcp:101:rm.0 Request processed in 619us (4354us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074921.980391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9315 00000100:00100000:3.0:1769074921.991517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074921.991685:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616068992 00000100:00100000:0.0:1769074921.991699:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616068992 00000100:00100000:0.0:1769074921.991779:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:0.0:1769074921.991791:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:2418:x1855007616068992:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074921.991856:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074921.991885:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe913f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f1f expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.991963:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.991981:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.991996:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992015:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074921.992022:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992029:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992101:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992108:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992115:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992121:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.992126:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992134:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992148:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.992152:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.992158:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992164:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9146 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992180:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992185:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992191:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992195:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074921.992199:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992217:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992224:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074921.992226:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074921.992229:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992235:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe914d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074921.992273:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe913f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f1f expref: 341 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.992284:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074921.992286:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074921.992290:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe913f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f1f expref: 341 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074921.992305:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc -2) 00000100:00100000:0.0:1769074921.992398:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:2418:x1855007616068992:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 609us (898us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074921.992408:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:3.0:1769074921.995680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.000720:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069120 00000100:00100000:1.0:1769074922.000742:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069120 00000100:00100000:1.0:1769074922.000854:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9316 00000100:00100000:1.0:1769074922.000867:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67300:x1855007616069120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074922.000901:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.000932:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9154 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f26 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.001021:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.001041:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001059:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001075:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.001082:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001089:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001161:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001168:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001175:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001181:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001187:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.001192:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001200:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001224:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.001227:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.001234:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001240:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe915b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001259:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001265:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001270:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001275:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.001278:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001283:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001290:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3d4f00) 00010000:00010000:1.0:1769074922.001292:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.001294:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001299:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9162 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.001337:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9154 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f26 expref: 341 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.001347:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.001351:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.001355:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9154 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f26 expref: 341 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.001363:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074922.001448:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67300:x1855007616069120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 584us (5785us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.001456:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9316 00000100:00100000:3.0:1769074922.023032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.026621:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069248 00000100:00100000:0.0:1769074922.026643:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069248 00000100:00100000:0.0:1769074922.026743:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9317 00000100:00100000:0.0:1769074922.026755:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67301:x1855007616069248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.026783:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.026821:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9169 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f2d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.026918:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.026936:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.026952:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.026973:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.026979:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.026984:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027062:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027070:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027076:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027082:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.027087:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027094:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027108:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.027111:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.027116:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027122:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe9170 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027139:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027145:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027150:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027155:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.027159:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027164:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027171:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074922.027174:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.027177:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027181:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9177 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.027232:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9169 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f2d expref: 341 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.027244:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.027246:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.027249:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9169 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f2d expref: 341 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.027259:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074922.027369:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67301:x1855007616069248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 615us (4353us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.027378:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9317 00000100:00100000:2.0:1769074922.031978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.032153:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069376 00000100:00100000:1.0:1769074922.032169:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069376 00000100:00100000:1.0:1769074922.032257:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9318 00000100:00100000:1.0:1769074922.032270:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67301:x1855007616069376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.032301:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.032332:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe917e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f34 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.032444:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.032464:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032479:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032508:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.032515:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032522:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032651:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032659:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032666:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032672:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032679:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.032684:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032692:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032707:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.032711:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.032718:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032724:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9185 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032746:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032752:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032758:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032764:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.032767:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032774:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032781:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3d4f00) 00010000:00010000:1.0:1769074922.032784:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.032787:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032792:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe918c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.032842:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe917e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f34 expref: 341 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.032853:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.032856:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.032860:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe917e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f34 expref: 341 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.032871:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074922.032970:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67301:x1855007616069376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 701us (1007us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.032979:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9318 00000100:00100000:3.0:1769074922.048521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.049072:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069632 00000100:00100000:0.0:1769074922.049087:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069632 00000100:00100000:0.0:1769074922.049169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9319 00000100:00100000:0.0:1769074922.049180:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67301:x1855007616069632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.049221:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.049250:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9193 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f3b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.049420:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.049441:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.049456:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.049475:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x993ede26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.049482:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.049488:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:0.0:1769074922.050261:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xad:0x0], index 1: 0 00010000:00010000:0.0:1769074922.050508:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe91a8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x163:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.050522:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe91a8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050565:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe91a8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050610:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050622:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050630:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050637:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.050642:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050651:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050928:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.050933:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.050940:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050947:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe919a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:0.0:1769074922.050963:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002361303a reply state 00000000971973c5 transno 4294968994 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050975:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.050980:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074922.050983:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074922.050986:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074922.051034:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14800/0x557988ac98fe9193 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f3b expref: 343 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.051056:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14000/0x557988ac98fe91a8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f3b expref: 342 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.051063:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x163:0x0].0x0 (ffff91604f3c6c00) 00010000:00010000:0.0:1769074922.051066:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074922.051068:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14000, rc 0) 00000100:00100000:0.0:1769074922.051178:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+343:67301:x1855007616069632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1999us (2670us total) trans 4294968994 rc 0/0 00000100:00100000:0.0:1769074922.051188:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9319 00000100:00100000:3.0:1769074922.062906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.063027:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069760 00000100:00100000:1.0:1769074922.063042:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069760 00000100:00100000:1.0:1769074922.063118:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2681 00000100:00100000:1.0:1769074922.063131:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+150:2420:x1855007616069760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.063157:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.063187:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f42 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074922.063228:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074922.063256:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.063258:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.063269:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.063291:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 151 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.063309:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074922.063399:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2420:x1855007616069760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 270us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.063408:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2681 00000100:00100000:2.0:1769074922.068055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.068249:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616069888 00000100:00100000:0.0:1769074922.068264:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616069888 00000100:00100000:0.0:1769074922.068340:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2682 00000100:00100000:0.0:1769074922.068351:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:67301:x1855007616069888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.068383:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.068408:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f49 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.068446:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.068455:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.068457:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.068462:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f49 expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.068503:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.068519:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:0.0:1769074922.068576:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626618240:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074922.068709:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074922.076735:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626618240:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074922.076798:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f49 expref: 152 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.076958:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14800, rc 0) 00000100:00100000:0.0:1769074922.077163:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:67301:x1855007616069888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 8811us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074922.077176:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2682 00000100:00100000:3.0:1769074922.079508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.079619:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070016 00000100:00100000:2.0:1769074922.079633:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070016 00010000:00010000:2.0:1769074922.079720:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:2.0:1769074922.079771:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1869 00000100:00100000:2.0:1769074922.079781:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2419:x1855007616070016:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074922.079991:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074922.080019:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.080036:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.080065:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98fe91b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f42 expref: 152 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.080087:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.080089:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.080098:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f49 expref: 151 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.080109:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f49 expref: 151 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.080162:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b14800/0x557988ac98fe91bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f49 expref: 151 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074922.080180:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626618368:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074922.080315:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604419cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1769074922.089217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.089359:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626618368:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074922.089405:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074922.089481:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2419:x1855007616070016:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9699us (9987us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.089495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1869 00000100:00100000:3.0:1769074922.091482:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070272 00000100:00100000:3.0:1769074922.091501:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070272 00000100:00100000:3.0:1769074922.091948:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1854 00000100:00100000:3.0:1769074922.091961:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916148470450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+343:67301:x1855007616070272:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074922.092612:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916148470450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67301:x1855007616070272:12345-192.168.204.32@tcp:35:cp.0 Request processed in 650us (3417us total) trans 4294968995 rc 0/0 00000100:00100000:3.0:1769074922.092622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1854 00000100:00100000:0.0:1769074922.141911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.142111:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070400 00000100:00100000:3.0:1769074922.142124:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070400 00000100:00100000:3.0:1769074922.142213:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9320 00000100:00100000:3.0:1769074922.142225:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67305:x1855007616070400:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074922.142253:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.142285:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f50 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.142477:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.142496:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142509:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142526:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.142577:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142584:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142858:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142866:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142873:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142879:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.142884:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142892:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142910:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.142913:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.142919:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142924:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142941:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142948:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142953:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142959:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.142962:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142966:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142971:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff916052a0c700) 00010000:00010000:3.0:1769074922.142973:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.142975:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.142979:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91d2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.143012:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91c4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f50 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.143020:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.143022:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.143024:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f50 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.143031:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:3.0:1769074922.143107:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67305:x1855007616070400:12345-192.168.204.32@tcp:101:bash.0 Request processed in 884us (1213us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074922.143115:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9320 00000100:00100000:2.0:1769074922.150415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.150467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.150647:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070528 00000100:00100000:3.0:1769074922.150670:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070528 00000100:00100000:3.0:1769074922.150745:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9321 00000100:00100000:3.0:1769074922.150757:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67306:x1855007616070528:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074922.150792:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.150820:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f57 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.150918:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.150938:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.150951:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.150967:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.150981:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.150989:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151055:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151064:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151071:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151077:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.151082:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151089:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151102:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.151106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.151111:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151117:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe91e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151130:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151136:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151142:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151147:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.151149:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151154:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151162:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff916052a0c700) 00010000:00010000:3.0:1769074922.151164:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.151167:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151172:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe91e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.151218:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91d9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f57 expref: 345 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.151229:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.151232:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.151236:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a6c00/0x557988ac98fe91d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f57 expref: 345 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.151247:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:3.0:1769074922.151318:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67306:x1855007616070528:12345-192.168.204.32@tcp:101:rm.0 Request processed in 563us (918us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074922.151326:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9321 00000100:00100000:2.0:1769074922.155283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.155437:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070784 00000100:00100000:3.0:1769074922.155453:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070784 00000100:00100000:3.0:1769074922.155566:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9322 00000100:00100000:3.0:1769074922.155579:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67306:x1855007616070784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074922.155609:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.155638:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe91ee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f65 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.155873:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074922.155892:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.155905:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.155921:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074922.155927:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.155933:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156004:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156011:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156017:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156029:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156036:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.156041:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156049:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156062:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.156066:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.156072:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156079:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe91f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156095:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156102:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156107:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156112:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.156114:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156119:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156131:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.156133:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.156136:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.156141:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe91fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000100:00100000:1.0:1769074922.157991:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070656 00010000:00010000:3.0:1769074922.157991:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe91ee lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f65 expref: 345 pid: 25081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074922.158005:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070656 00010000:00010000:3.0:1769074922.158012:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.158016:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.158021:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe91ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f65 expref: 346 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.158040:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:1.0:1769074922.158087:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 142 00000100:00100000:1.0:1769074922.158099:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616070656:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074922.158138:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.158157:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9203 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f5e expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.158227:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.158242:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158253:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158266:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.158272:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158278:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158335:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158342:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158348:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158353:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.158358:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158454:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158462:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.158464:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.158468:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158473:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe920a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158486:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158794:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158929:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158934:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.158937:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158942:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158952:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f3d4300) 00010000:00010000:1.0:1769074922.158954:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.158957:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.158963:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9211 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.159003:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9203 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f5e expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.159012:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.159014:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074922.159018:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9203 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f5e expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.159027:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095e00, rc -2) 00000100:00100000:1.0:1769074922.159126:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2417:x1855007616070656:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1028us (8657us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074922.159137:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 142 00000100:00100000:0.0:1769074922.165455:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67306:x1855007616070784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 9781us (10090us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.165471:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9322 00000100:00100000:2.0:1769074922.182315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.182590:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616070912 00000100:00100000:0.0:1769074922.182603:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616070912 00000100:00100000:0.0:1769074922.182691:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9323 00000100:00100000:0.0:1769074922.182703:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67307:x1855007616070912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.182732:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.182762:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9218 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f6c expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.182871:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.182892:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.182906:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.182923:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.182930:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.182936:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183004:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183011:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183017:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183024:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183030:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.183034:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183047:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183060:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.183063:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.183069:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183075:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe921f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183089:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183095:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183101:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183106:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.183108:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183114:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183119:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff91604f3c6200) 00010000:00010000:0.0:1769074922.183122:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.183124:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183129:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9226 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.183167:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9218 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f6c expref: 345 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.183178:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.183181:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.183184:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9218 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f6c expref: 345 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.183194:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:0.0:1769074922.183286:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67307:x1855007616070912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 585us (987us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.183294:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9323 00000100:00100000:3.0:1769074922.186043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.190374:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071040 00000100:00100000:0.0:1769074922.190401:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071040 00000100:00100000:0.0:1769074922.190548:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9324 00000100:00100000:0.0:1769074922.190562:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67307:x1855007616071040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.190593:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.190622:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe922d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f73 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.190745:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.190767:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190780:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190803:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.190809:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190816:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190890:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190899:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190905:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190912:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190919:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.190924:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190933:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190949:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.190952:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.190958:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190964:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9234 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190980:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190985:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190991:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.190996:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.190999:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.191005:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.191012:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff91604f3c6200) 00010000:00010000:0.0:1769074922.191015:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.191018:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.191023:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4a600/0x557988ac98fe923b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.191060:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe922d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f73 expref: 345 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.191071:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.191073:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.191077:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe922d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f73 expref: 345 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.191092:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc 0) 00000100:00100000:0.0:1769074922.191186:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67307:x1855007616071040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 627us (5157us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.191195:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9324 00000100:00100000:3.0:1769074922.194782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.204931:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071296 00000100:00100000:0.0:1769074922.204957:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071296 00000100:00100000:1.0:1769074922.205186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9325 00000100:00100000:1.0:1769074922.205220:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67307:x1855007616071296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.205251:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.205280:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9242 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f7a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.205453:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074922.205473:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.205487:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.205503:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x71c26934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074922.205511:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.205517:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:1.0:1769074922.205970:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xad:0x0], index 0: 0 00010000:00010000:1.0:1769074922.206158:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094000/0x557988ac98fe9257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x164:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074922.206167:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094000/0x557988ac98fe9257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206175:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094000/0x557988ac98fe9257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206231:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206240:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206247:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206254:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.206259:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206266:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206280:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.206284:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.206289:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206295:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9249 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:1.0:1769074922.206313:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000013641a3b reply state 00000000b0ceae8e transno 4294968996 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206324:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074922.206330:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff91604f3d4300) 00010000:00010000:1.0:1769074922.206332:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074922.206335:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074922.206372:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe9242 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f7a expref: 347 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.206387:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094000/0x557988ac98fe9257 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x164:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f7a expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.206394:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x164:0x0].0x0 (ffff91604f3d4500) 00010000:00010000:1.0:1769074922.206396:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074922.206399:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094000, rc 0) 00000100:00100000:1.0:1769074922.206523:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+347:67307:x1855007616071296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1326us (11755us total) trans 4294968996 rc 0/0 00000100:00100000:1.0:1769074922.206588:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9325 00000100:00100000:2.0:1769074922.210914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.210971:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071424 00000100:00100000:0.0:1769074922.210985:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071424 00000100:00100000:0.0:1769074922.211092:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2683 00000100:00100000:0.0:1769074922.211105:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2420:x1855007616071424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.211130:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.211156:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f81 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074922.211197:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074922.211234:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.211236:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.211246:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.211265:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.211279:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc 0) 00000100:00100000:0.0:1769074922.211356:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2420:x1855007616071424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 253us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074922.211368:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2683 00000100:00100000:3.0:1769074922.215334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.215385:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071552 00000100:00100000:0.0:1769074922.215399:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071552 00000100:00100000:0.0:1769074922.215477:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2684 00000100:00100000:0.0:1769074922.215498:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:67307:x1855007616071552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.215524:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.215569:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f88 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.215610:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 154 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.215618:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.215620:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.216004:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f88 expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.216053:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 154 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074922.216070:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 154 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:0.0:1769074922.216086:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626618496:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074922.216351:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042ce1840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074922.223709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.223829:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071680 00000100:00100000:1.0:1769074922.223843:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071680 00000100:00100000:3.0:1769074922.223903:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626618496:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074922.223922:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 155 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:3.0:1769074922.223944:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f88 expref: 155 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.223965:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4a600, rc 0) 00000100:00100000:1.0:1769074922.223972:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1870 00000100:00100000:1.0:1769074922.223982:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2419:x1855007616071680:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074922.224001:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074922.224028:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 155 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:1.0:1769074922.224042:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 155 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:3.0:1769074922.224048:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:67307:x1855007616071552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 8562us (8728us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074922.224056:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2684 00010000:00010000:1.0:1769074922.224072:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052b4b600/0x557988ac98fe9265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f81 expref: 155 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:1.0:1769074922.224089:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.224091:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.224102:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f88 expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.224114:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f88 expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.224156:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052b4a600/0x557988ac98fe926c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f88 expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074922.224171:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626618624:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074922.224253:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:1.0:1769074922.231242:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626618624:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074922.231279:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074922.231496:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2419:x1855007616071680:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7512us (8006us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.231511:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1870 00000100:00100000:2.0:1769074922.237878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.237975:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616071936 00000100:00100000:3.0:1769074922.237990:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616071936 00000100:00100000:3.0:1769074922.238101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1855 00000100:00100000:3.0:1769074922.238113:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+347:67307:x1855007616071936:12345-192.168.204.32@tcp:35:cp.0 00000001:00080000:3.0:1769074922.238433:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968997 00000100:00100000:3.0:1769074922.238604:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67307:x1855007616071936:12345-192.168.204.32@tcp:35:cp.0 Request processed in 491us (740us total) trans 4294968998 rc 0/0 00000100:00100000:3.0:1769074922.238613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1855 00000020:00080000:3.0:1769074922.238620:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1769074922.283883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.284149:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072064 00000100:00100000:3.0:1769074922.284164:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072064 00000100:00100000:3.0:1769074922.284256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9326 00000100:00100000:3.0:1769074922.284267:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67310:x1855007616072064:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074922.284296:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.284325:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9273 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f8f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.284420:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.284438:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284452:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284469:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074922.284476:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284483:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284600:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284608:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284615:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284621:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.284817:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284827:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284841:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.284844:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.284850:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284858:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe927a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284875:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284881:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284887:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284893:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.284895:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284902:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284909:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.284911:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.284914:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284919:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9281 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074922.284962:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9273 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f8f expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.284973:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.284975:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.284979:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9273 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f8f expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.284988:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc 0) 00000100:00100000:3.0:1769074922.285074:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67310:x1855007616072064:12345-192.168.204.32@tcp:101:bash.0 Request processed in 809us (1206us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074922.285082:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9326 00000100:00100000:1.0:1769074922.295707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.295761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.295923:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072320 00000100:00100000:3.0:1769074922.295938:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072320 00000100:00100000:3.0:1769074922.296013:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 143 00000100:00100000:3.0:1769074922.296024:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2420:x1855007616072320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074922.296094:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.296121:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9288 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f9d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.296208:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.296229:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296243:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296263:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.296271:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296277:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296352:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296359:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296366:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296373:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.296379:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296388:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296403:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.296406:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.296412:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296418:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe928f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296432:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296437:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296442:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296446:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.296449:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296454:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296460:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.296463:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.296465:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.296476:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9296 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00000100:00100000:0.0:1769074922.296573:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072192 00000100:00100000:0.0:1769074922.296580:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072192 00000100:00100000:0.0:1769074922.296634:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9327 00000100:00100000:0.0:1769074922.296643:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+351:67311:x1855007616072192:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074922.296654:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.296678:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe929d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29f96 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.296715:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.296729:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.296738:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.296752:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074922.296759:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.296765:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.296794:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.296979:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9288 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f9d expref: 352 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.299108:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.299129:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.299138:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.299148:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.299151:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.299156:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074922.299167:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9288 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f9d expref: 352 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.299192:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc -2) 00000100:00100000:3.0:1769074922.299412:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+351:2420:x1855007616072320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3387us (3647us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074922.299425:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 143 00010000:00010000:0.0:1769074922.300273:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300289:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300310:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.300314:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.300319:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300327:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe92a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300347:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300354:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300361:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300366:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.300369:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300376:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300387:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.300389:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.300392:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300397:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe92ab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074922.300460:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe929d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f96 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.300470:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.300472:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.300475:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe929d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29f96 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.300483:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:1.0:1769074922.302261:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67311:x1855007616072192:12345-192.168.204.32@tcp:101:rm.0 Request processed in 5605us (6552us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.302276:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9327 00000100:00100000:2.0:1769074922.305102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.305245:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072448 00000100:00100000:1.0:1769074922.305261:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072448 00000100:00100000:1.0:1769074922.305381:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9328 00000100:00100000:1.0:1769074922.305395:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67311:x1855007616072448:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074922.305428:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.305458:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29fd5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.305920:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.305939:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.305953:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.305972:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.305981:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.305988:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306066:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306075:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306082:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306088:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306095:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.306099:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306107:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306121:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.306125:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.306131:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306138:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306158:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306165:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306171:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306175:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.306178:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306184:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306191:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f3d4900) 00010000:00010000:1.0:1769074922.306194:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.306207:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306214:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92c0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.306255:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92b2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29fd5 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.306266:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.306268:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.306273:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29fd5 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.306282:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095e00, rc 0) 00000100:00100000:1.0:1769074922.306362:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67311:x1855007616072448:12345-192.168.204.32@tcp:101:rm.0 Request processed in 970us (1274us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.306373:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9328 00000100:00100000:2.0:1769074922.337316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.337441:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072704 00000100:00100000:1.0:1769074922.337456:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072704 00000100:00100000:1.0:1769074922.337527:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9329 00000100:00100000:1.0:1769074922.337584:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67314:x1855007616072704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.337611:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.337637:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a014 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.337738:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.337757:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337770:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337785:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074922.337792:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337798:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337877:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337885:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337891:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337898:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337903:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.337908:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337916:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337931:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.337935:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.337942:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337949:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe92ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337966:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337971:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337977:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337981:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.337983:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337993:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.337999:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f3d4900) 00010000:00010000:1.0:1769074922.338001:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.338004:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.338009:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe92d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074922.338050:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92c7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a014 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.338060:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.338062:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.338066:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095e00/0x557988ac98fe92c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a014 expref: 350 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.338075:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095e00, rc 0) 00000100:00100000:1.0:1769074922.338267:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67314:x1855007616072704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 684us (963us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.338275:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9329 00000100:00100000:0.0:1769074922.343668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.343832:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072832 00000100:00100000:2.0:1769074922.343848:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072832 00000100:00100000:2.0:1769074922.343930:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9330 00000100:00100000:2.0:1769074922.343943:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67314:x1855007616072832:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.343974:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.344003:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a01b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.344109:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.344127:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344140:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344157:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.344168:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344175:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344254:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344263:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344271:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344279:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.344284:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344291:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344307:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.344311:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.344316:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344323:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe92e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344338:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344344:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344351:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344356:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.344370:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344375:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344384:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f4df000) 00010000:00010000:2.0:1769074922.344386:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.344389:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344395:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe92ea lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.344434:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92dc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a01b expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.344445:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.344447:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.344450:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a01b expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.344460:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ee00, rc 0) 00000100:00100000:2.0:1769074922.344603:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67314:x1855007616072832:12345-192.168.204.32@tcp:101:cp.0 Request processed in 662us (951us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.344611:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9330 00000100:00100000:3.0:1769074922.348847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.349145:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073088 00000100:00100000:2.0:1769074922.349159:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073088 00000100:00100000:2.0:1769074922.349250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9331 00000100:00100000:2.0:1769074922.349262:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67314:x1855007616073088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.349291:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.349320:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe92f1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a022 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.349803:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.350753:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.350773:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.350972:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.350982:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.350990:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:2.0:1769074922.351448:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xae:0x0], index 1: 0 00010000:00010000:2.0:1769074922.354451:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe9306 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x165:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.354482:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe9306 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354508:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe9306 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354602:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354609:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354616:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354622:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.354627:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354635:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354650:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.354653:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.354670:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354677:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe92f8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:2.0:1769074922.354695:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a8d160bd reply state 000000006eb24643 transno 4294968999 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354707:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.354713:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f4df000) 00010000:00010000:2.0:1769074922.354715:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074922.354719:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074922.354765:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe92f1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a022 expref: 352 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.354781:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e000/0x557988ac98fe9306 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a022 expref: 351 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.354788:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x165:0x0].0x0 (ffff91604f4df300) 00010000:00010000:2.0:1769074922.354790:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074922.354793:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e000, rc 0) 00000100:00100000:2.0:1769074922.356341:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67314:x1855007616073088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7066us (7493us total) trans 4294968999 rc 0/0 00000100:00100000:2.0:1769074922.356355:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9331 00000100:00100000:0.0:1769074922.357185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.358231:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616072576 00000100:00100000:3.0:1769074922.358247:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616072576 00000100:00100000:3.0:1769074922.358329:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 144 00000100:00100000:3.0:1769074922.358341:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:2418:x1855007616072576:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074922.358422:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.358449:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9314 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e29fdc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.358575:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.358594:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.358607:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.358623:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.358631:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.358637:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359013:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359023:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359030:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359037:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.359042:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359051:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359066:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.359069:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.359075:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359081:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe931b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359097:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359102:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359108:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359112:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.359115:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359120:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359127:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.359129:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.359132:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359137:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9322 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.359177:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9314 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29fdc expref: 353 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.359188:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.359190:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074922.359194:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9314 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e29fdc expref: 353 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.359219:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc -2) 00000100:00100000:3.0:1769074922.359377:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:2418:x1855007616072576:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1036us (2194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074922.359388:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 144 00000100:00100000:1.0:1769074922.375996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.376090:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073216 00000100:00100000:3.0:1769074922.376105:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073216 00000100:00100000:3.0:1769074922.376186:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2685 00000100:00100000:3.0:1769074922.376208:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+151:2417:x1855007616073216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074922.376235:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.376264:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a029 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074922.376296:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074922.376322:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.376325:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.376338:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 152 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.376372:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 152 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.376391:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc 0) 00000100:00100000:3.0:1769074922.376464:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2417:x1855007616073216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 267us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074922.376471:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2685 00000100:00100000:0.0:1769074922.385050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.386294:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073344 00000100:00100000:1.0:1769074922.386312:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073344 00000100:00100000:1.0:1769074922.386410:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2686 00000100:00100000:1.0:1769074922.386422:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:67314:x1855007616073344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.386450:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.386475:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a030 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.386525:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.386920:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.386922:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.386929:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a030 expref: 153 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.386979:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.386996:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 153 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:1.0:1769074922.387015:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626618752:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074922.387283:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074922.399334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.401332:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073472 00000100:00100000:2.0:1769074922.401363:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073472 00010000:00010000:2.0:1769074922.401452:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 154 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:2.0:1769074922.401516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1871 00000100:00100000:2.0:1769074922.401527:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2420:x1855007616073472:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074922.401592:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074922.401621:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 154 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.401638:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 154 pid: 24564 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.401681:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.401684:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.401694:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a030 expref: 154 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.401705:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a030 expref: 154 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.401758:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a030 expref: 154 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074922.401777:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626618880:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074922.402079:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160458930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074922.406992:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626618880:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074922.407034:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074922.407120:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2420:x1855007616073472:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5593us (7795us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074922.407135:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1871 00010000:00010000:1.0:1769074922.407526:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052adb400/0x557988ac98fe9329 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a029 expref: 153 pid: 24564 timeout: 2011 lvb_type: 1 00000100:00100000:1.0:1769074922.407566:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626618752:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074922.407592:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095e00/0x557988ac98fe9330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a030 expref: 152 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.407616:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095e00, rc 0) 00000100:00100000:1.0:1769074922.407731:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:67314:x1855007616073344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 21232us (22618us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.407741:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2686 00000100:00100000:3.0:1769074922.415258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.415371:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073728 00000100:00100000:1.0:1769074922.415386:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073728 00000100:00100000:1.0:1769074922.415457:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1856 00000100:00100000:1.0:1769074922.415468:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67314:x1855007616073728:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074922.415897:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67314:x1855007616073728:12345-192.168.204.32@tcp:35:cp.0 Request processed in 430us (654us total) trans 4294969000 rc 0/0 00000100:00100000:1.0:1769074922.415906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1856 00000100:00100000:0.0:1769074922.447587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.447691:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073856 00000100:00100000:3.0:1769074922.447707:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073856 00000100:00100000:3.0:1769074922.447782:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 145 00000100:00100000:3.0:1769074922.447794:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616073856:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074922.448065:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.448093:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9337 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a037 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.448175:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.448193:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448219:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448237:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.448245:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448253:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448321:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448329:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448337:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448345:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.448351:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448449:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448463:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.448466:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.448472:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448479:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe933e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448504:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448511:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448517:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448522:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.448525:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448582:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448590:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.448593:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.448597:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448602:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9345 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.448639:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9337 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a037 expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.448650:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.448658:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074922.448662:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9337 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a037 expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.448671:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc -2) 00000100:00100000:3.0:1769074922.448770:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616073856:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 976us (1247us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074922.448779:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 145 00000100:00100000:3.0:1769074922.464191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.464566:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616073984 00000100:00100000:2.0:1769074922.464581:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616073984 00000100:00100000:2.0:1769074922.464660:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9332 00000100:00100000:2.0:1769074922.464672:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67321:x1855007616073984:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074922.464699:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.464727:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe934c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a06f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.464838:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.464859:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464872:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464886:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074922.464892:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464898:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464964:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464971:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464978:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464984:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.464988:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.464996:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465008:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.465012:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.465018:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465024:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9353 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465037:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465043:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465048:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465051:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.465053:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465058:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465064:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:2.0:1769074922.465067:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.465070:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465075:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe935a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074922.465110:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe934c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a06f expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.465121:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.465124:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.465127:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe934c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a06f expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.465136:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.465227:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67321:x1855007616073984:12345-192.168.204.32@tcp:101:bash.0 Request processed in 556us (1050us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.465235:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9332 00000100:00100000:1.0:1769074922.483013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.483934:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074112 00000100:00100000:2.0:1769074922.483951:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074112 00000100:00100000:2.0:1769074922.484038:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9333 00000100:00100000:2.0:1769074922.484050:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67322:x1855007616074112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074922.484080:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.484107:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9361 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a076 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.484210:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.484229:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.484244:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.484261:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.484269:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.484276:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.484353:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485035:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485041:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485048:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485055:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.485060:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485068:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485084:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.485087:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.485094:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485101:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9368 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485120:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485127:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485132:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485137:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.485140:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485146:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485154:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:2.0:1769074922.485156:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.485158:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485164:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe936f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.485226:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9361 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a076 expref: 354 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.485238:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.485240:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.485244:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9361 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a076 expref: 354 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.485253:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.486920:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67322:x1855007616074112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1310us (2359us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.486935:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9333 00000100:00100000:0.0:1769074922.491691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.491744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.491830:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074240 00000100:00100000:3.0:1769074922.491845:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074240 00000100:00100000:2.0:1769074922.491922:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074368 00000100:00100000:2.0:1769074922.491928:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074368 00000100:00100000:3.0:1769074922.491960:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 146 00000100:00100000:3.0:1769074922.491973:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+354:2419:x1855007616074240:12345-192.168.204.32@tcp:63:ll_sa.0 00000100:00100000:2.0:1769074922.491978:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9334 00000100:00100000:2.0:1769074922.491985:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+354:67322:x1855007616074368:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074922.492003:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.492022:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.492034:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9376 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a084 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.492034:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe937d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a07d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.492108:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074922.492108:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074922.492126:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.492141:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.492167:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.492175:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.492181:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.492263:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.495329:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495368:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495416:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.495426:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495433:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074922.495459:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495467:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495473:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495481:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.495487:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.495521:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495541:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495547:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495552:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.495555:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495565:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495579:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.495582:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.495589:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495595:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9384 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074922.495614:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.495614:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495621:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495626:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495631:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.495635:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495640:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495646:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff916052a0cb00) 00010000:00010000:3.0:1769074922.495649:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.495652:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495657:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9399 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.495712:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe937d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a07d expref: 356 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.495718:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.495721:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.495724:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495729:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe938b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.495729:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.495732:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074922.495735:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe937d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a07d expref: 356 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.495744:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074922.495745:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc -2) 00010000:00010000:2.0:1769074922.495749:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495754:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495760:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.495762:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495767:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495774:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:2.0:1769074922.495776:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.495779:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.495784:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe9392 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000100:00100000:3.0:1769074922.495865:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:2419:x1855007616074240:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3892us (4188us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074922.495878:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 146 00010000:00010000:2.0:1769074922.495889:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9376 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a084 expref: 355 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.495898:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.495900:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.495904:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9376 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a084 expref: 354 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.495912:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.495947:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67322:x1855007616074368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 3962us (4202us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.495955:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9334 00000100:00100000:0.0:1769074922.518271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.518347:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074496 00000100:00100000:2.0:1769074922.518437:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074496 00000100:00100000:2.0:1769074922.518794:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9335 00000100:00100000:2.0:1769074922.518942:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67323:x1855007616074496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.518976:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.519007:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe93a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a08b expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.519107:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.519126:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519142:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519159:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.519167:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519174:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519263:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519272:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519278:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519285:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519291:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.519296:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519304:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519320:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.519324:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.519331:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519337:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519365:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519373:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519379:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519384:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.519387:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519393:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519400:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:2.0:1769074922.519403:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.519406:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519412:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.519448:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe93a0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a08b expref: 354 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.519460:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.519464:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.519468:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe93a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a08b expref: 354 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.519477:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.519912:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67323:x1855007616074496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1105us (1654us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.519922:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9335 00000100:00100000:3.0:1769074922.524580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.524815:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074624 00000100:00100000:0.0:1769074922.524830:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074624 00000100:00100000:0.0:1769074922.524915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9336 00000100:00100000:0.0:1769074922.524927:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67323:x1855007616074624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.524958:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.524990:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe93b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a092 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.525083:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.525101:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525116:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525135:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074922.525141:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525148:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525233:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525242:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525249:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525256:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.525261:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525273:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525288:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.525292:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.525298:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525305:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe93bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525321:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525328:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525335:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525340:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.525343:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525348:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525356:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.525358:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.525361:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525368:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074922.525407:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe93b5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a092 expref: 354 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.525418:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.525420:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.525424:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe93b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a092 expref: 354 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.525434:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc 0) 00000100:00100000:0.0:1769074922.525528:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67323:x1855007616074624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 602us (1000us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.525569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9336 00000100:00100000:3.0:1769074922.530592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.530815:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616074880 00000100:00100000:2.0:1769074922.530830:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616074880 00000100:00100000:2.0:1769074922.530904:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9337 00000100:00100000:2.0:1769074922.530916:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67323:x1855007616074880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.530943:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.530972:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe93ca lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a099 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.531132:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.531150:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.531162:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.531176:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.531184:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.531191:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074922.531791:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xae:0x0], index 0: 0 00010000:00010000:2.0:1769074922.531984:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe93df lrc: 3/1,0 mode: --/PR res: [0x240000403:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.531996:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe93df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532004:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe93df lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532045:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532052:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532057:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532064:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532070:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.532075:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532084:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532098:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.532102:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.532107:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532117:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe93d1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074922.532131:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000496f951d reply state 00000000d464412f transno 4294969001 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532141:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.532147:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:2.0:1769074922.532149:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074922.532153:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074922.532191:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe93ca lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a099 expref: 356 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.532221:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ec00/0x557988ac98fe93df lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x166:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a099 expref: 355 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.532228:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x166:0x0].0x0 (ffff91604f4dfc00) 00010000:00010000:2.0:1769074922.532231:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074922.532233:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ec00, rc 0) 00000100:00100000:2.0:1769074922.532334:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67323:x1855007616074880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1419us (1806us total) trans 4294969001 rc 0/0 00000100:00100000:2.0:1769074922.532344:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9337 00000100:00100000:0.0:1769074922.536650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.536909:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075008 00000100:00100000:3.0:1769074922.536924:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075008 00000100:00100000:3.0:1769074922.537001:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2687 00000100:00100000:3.0:1769074922.537013:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2419:x1855007616075008:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074922.537039:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.537073:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0a0 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074922.537107:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074922.537132:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.537135:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.537146:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 154 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.537169:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 154 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.537187:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:3.0:1769074922.537289:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2419:x1855007616075008:12345-192.168.204.32@tcp:101:cp.0 Request processed in 277us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074922.537297:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2687 00000100:00100000:0.0:1769074922.542464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.542587:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075136 00000100:00100000:3.0:1769074922.542603:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075136 00000100:00100000:3.0:1769074922.542681:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2688 00000100:00100000:3.0:1769074922.542692:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:67323:x1855007616075136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074922.542717:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.542747:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0a7 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.542786:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.542795:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.542798:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074922.542815:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a7 expref: 155 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.542862:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074922.542878:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:3.0:1769074922.542896:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626619008:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074922.543027:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617f95a180 going to sleep for 11 seconds 00000100:00100000:3.0:1769074922.549786:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626619008:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074922.549848:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a7 expref: 155 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.549873:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a6c00, rc 0) 00000100:00100000:3.0:1769074922.549953:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:67323:x1855007616075136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7262us (7505us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074922.549964:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2688 00000100:00100000:0.0:1769074922.552511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.552796:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075264 00000100:00100000:2.0:1769074922.552817:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075264 00010000:00010000:2.0:1769074922.552892:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 2011 lvb_type: 1 00000100:00100000:2.0:1769074922.552944:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1872 00000100:00100000:2.0:1769074922.552954:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2420:x1855007616075264:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074922.552972:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074922.552998:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.553014:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.553044:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe93ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a0 expref: 155 pid: 25313 timeout: 2011 lvb_type: 1 00010000:00010000:2.0:1769074922.553064:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.553066:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.553075:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a7 expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.553086:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a7 expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.553137:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a6c00/0x557988ac98fe93f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0a7 expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074922.553155:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626619136:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074922.553279:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160e4dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1769074922.561260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.561428:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626619136:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074922.561462:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074922.561585:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2420:x1855007616075264:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8630us (9093us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074922.561599:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1872 00000100:00100000:3.0:1769074922.561835:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075520 00000100:00100000:3.0:1769074922.561847:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075520 00000100:00100000:3.0:1769074922.561909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1857 00000100:00100000:3.0:1769074922.561920:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67323:x1855007616075520:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074922.562328:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67323:x1855007616075520:12345-192.168.204.32@tcp:35:cp.0 Request processed in 408us (1083us total) trans 4294969002 rc 0/0 00000100:00100000:3.0:1769074922.562337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1857 00000100:00100000:3.0:1769074922.593039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.593378:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075648 00000100:00100000:0.0:1769074922.593394:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075648 00000100:00100000:0.0:1769074922.593477:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9338 00000100:00100000:0.0:1769074922.593490:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67326:x1855007616075648:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074922.593517:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.593593:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0ae expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.593689:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.593709:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593723:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593741:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.593748:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593754:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593831:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593839:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593845:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593852:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593858:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.593862:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593870:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593886:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.593889:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.593895:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593901:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9402 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593918:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593924:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593930:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593935:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.593938:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593943:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593950:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.593953:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.593956:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.593962:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9409 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.594001:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93fb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0ae expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.594012:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.594015:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.594019:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe93fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0ae expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.594027:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:0.0:1769074922.594117:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67326:x1855007616075648:12345-192.168.204.32@tcp:101:bash.0 Request processed in 629us (1092us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.594125:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9338 00000100:00100000:0.0:1769074922.611520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.611727:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075776 00000100:00100000:2.0:1769074922.611741:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075776 00000100:00100000:2.0:1769074922.611832:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9339 00000100:00100000:2.0:1769074922.611844:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67327:x1855007616075776:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074922.611880:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.611908:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9410 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0b5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.611999:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.612019:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612034:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612051:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.612058:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612065:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612138:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612147:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612154:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612161:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612168:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.612173:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612182:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612208:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.612212:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.612218:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612224:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9417 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612240:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612247:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612253:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612258:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.612262:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612267:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612274:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f4df200) 00010000:00010000:2.0:1769074922.612277:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.612279:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612285:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe941e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.612319:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9410 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0b5 expref: 358 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.612331:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.612334:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.612337:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9410 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0b5 expref: 358 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.612345:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.612430:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67327:x1855007616075776:12345-192.168.204.32@tcp:101:rm.0 Request processed in 589us (924us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.612439:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9339 00000100:00100000:3.0:1769074922.615489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.615622:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616075904 00000100:00100000:0.0:1769074922.615636:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616075904 00000100:00100000:0.0:1769074922.615706:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9340 00000100:00100000:0.0:1769074922.615717:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67327:x1855007616075904:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074922.615743:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.615769:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9425 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0bc expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.615874:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.615893:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.615908:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.615926:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.615933:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.615944:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616021:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616029:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616035:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616041:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616047:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.616051:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616059:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616073:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.616076:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.616082:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616089:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe942c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616104:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616110:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616116:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616120:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.616123:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616128:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616134:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.616136:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.616138:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616142:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9433 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.616180:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9425 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0bc expref: 358 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.616208:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.616212:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.616216:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9425 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0bc expref: 358 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.616226:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc 0) 00000100:00100000:0.0:1769074922.616315:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67327:x1855007616075904:12345-192.168.204.32@tcp:101:rm.0 Request processed in 598us (841us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.616324:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9340 00000100:00100000:3.0:1769074922.627010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.634789:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076032 00000100:00100000:0.0:1769074922.634820:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076032 00000100:00100000:0.0:1769074922.634917:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00100000:0.0:1769074922.634930:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2420:x1855007616076032:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074922.635012:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.635039:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe943a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0c3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.635113:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.635131:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635143:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635161:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.635169:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635175:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635259:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635267:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635274:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635281:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.635286:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635294:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635307:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.635311:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.635316:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635322:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9441 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635337:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635343:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635348:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635363:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.635366:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635371:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635377:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.635379:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.635382:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635387:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9448 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.635419:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe943a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0c3 expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.635429:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.635431:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074922.635434:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe943a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0c3 expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.635442:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc -2) 00000100:00100000:0.0:1769074922.635605:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2420:x1855007616076032:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 677us (8611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074922.635614:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00100000:3.0:1769074922.640377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.640480:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076160 00000100:00100000:2.0:1769074922.640506:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076160 00000100:00100000:2.0:1769074922.640615:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9341 00000100:00100000:2.0:1769074922.640627:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67330:x1855007616076160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.640661:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.640689:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe944f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a0fb expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.640783:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.640814:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640828:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640845:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.640853:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640860:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640930:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640938:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640944:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640950:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640956:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.640961:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640969:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.640984:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.640988:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.640993:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641000:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9456 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641016:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641022:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641027:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641031:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.641033:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641038:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641045:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f4df200) 00010000:00010000:2.0:1769074922.641048:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.641051:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641060:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe945d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.641094:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe944f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0fb expref: 358 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.641104:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.641106:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.641109:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe944f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a0fb expref: 358 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.641118:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.641210:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67330:x1855007616076160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 584us (857us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.641219:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9341 00000100:00100000:3.0:1769074922.643311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.643571:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076288 00000100:00100000:0.0:1769074922.643584:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076288 00000100:00100000:0.0:1769074922.643670:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9342 00000100:00100000:0.0:1769074922.643681:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67330:x1855007616076288:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.643708:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.643735:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9464 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a102 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.643825:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.643845:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643858:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643874:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.643881:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643886:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643960:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643968:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643975:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643981:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.643987:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.643992:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644000:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644014:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.644017:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.644024:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644031:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe946b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644048:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644053:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644058:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644063:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.644066:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644071:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644077:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074922.644080:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.644083:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644088:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe9472 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.644126:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9464 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a102 expref: 358 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.644136:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.644140:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.644144:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe9464 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a102 expref: 358 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.644166:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc 0) 00000100:00100000:0.0:1769074922.644260:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67330:x1855007616076288:12345-192.168.204.32@tcp:101:cp.0 Request processed in 581us (962us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074922.644268:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9342 00000100:00100000:3.0:1769074922.647062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.647226:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076416 00000100:00100000:1.0:1769074922.647240:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076416 00000100:00100000:1.0:1769074922.647308:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 148 00000100:00100000:1.0:1769074922.647320:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2420:x1855007616076416:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074922.647394:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.647422:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe9479 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a109 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.647503:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.647521:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647581:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647598:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.647604:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647610:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647693:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647701:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647707:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647713:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.647718:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647725:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647739:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.647743:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.647749:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647755:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094e00/0x557988ac98fe9480 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647775:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647781:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647786:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647791:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.647793:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647810:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647818:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f3d4900) 00010000:00010000:1.0:1769074922.647820:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.647823:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647829:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9487 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.647862:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe9479 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a109 expref: 358 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.647872:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.647874:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074922.647877:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe9479 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a109 expref: 358 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.647890:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095400, rc -2) 00000100:00100000:1.0:1769074922.647975:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2420:x1855007616076416:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 656us (926us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074922.647983:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 148 00000100:00100000:3.0:1769074922.651618:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.655456:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076672 00000100:00100000:0.0:1769074922.655479:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076672 00000100:00100000:0.0:1769074922.655969:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9343 00000100:00100000:0.0:1769074922.655982:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67330:x1855007616076672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074922.656010:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.656035:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe948e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a141 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.656212:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.656230:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.656243:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.656260:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074922.656266:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074922.656272:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:1.0:1769074922.663412:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xaf:0x0], index 1: 0 00010000:00010000:1.0:1769074922.666147:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe94a3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.666179:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe94a3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666202:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe94a3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666256:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666263:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666270:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666276:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666282:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.666286:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666294:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666309:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.666313:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.666318:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666325:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9495 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:1.0:1769074922.666343:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c1779fd3 reply state 00000000483ab428 transno 4294969003 ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666367:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.666373:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f3c6a00) 00010000:00010000:1.0:1769074922.666375:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074922.666379:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074922.666428:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe948e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a141 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.666444:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095400/0x557988ac98fe94a3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a141 expref: 359 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.666451:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x167:0x0].0x0 (ffff91604f3d4900) 00010000:00010000:1.0:1769074922.666454:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074922.666457:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095400, rc 0) 00000100:00100000:1.0:1769074922.666672:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67330:x1855007616076672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10690us (15069us total) trans 4294969003 rc 0/0 00000100:00100000:1.0:1769074922.666682:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9343 00000100:00100000:3.0:1769074922.673904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.674078:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076800 00000100:00100000:1.0:1769074922.674093:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076800 00000100:00100000:1.0:1769074922.674180:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2689 00000100:00100000:1.0:1769074922.674202:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+152:2420:x1855007616076800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.674227:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.674255:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a148 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074922.674286:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074922.674313:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.674316:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.674328:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.674352:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 153 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.674368:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095200, rc 0) 00000100:00100000:1.0:1769074922.674450:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2420:x1855007616076800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 259us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.674458:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2689 00010000:00010000:1.0:1769074922.676944:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074922.681828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.681940:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616076928 00000100:00100000:1.0:1769074922.681955:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616076928 00000100:00100000:1.0:1769074922.682022:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2690 00000100:00100000:1.0:1769074922.682032:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:67330:x1855007616076928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.682054:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.682076:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a14f expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.682112:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.682120:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.682123:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.682127:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a14f expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.682169:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.682183:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074922.682209:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626619264:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074922.682335:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074922.685843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.685981:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626619264:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074922.686026:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a14f expref: 154 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.686052:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094e00, rc 0) 00000100:00100000:1.0:1769074922.686132:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:67330:x1855007616076928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4100us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.686142:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2690 00000100:00100000:0.0:1769074922.686318:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077056 00000100:00100000:0.0:1769074922.686328:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077056 00010000:00010000:0.0:1769074922.686405:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:0.0:1769074922.686447:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1873 00000100:00100000:0.0:1769074922.686457:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2420:x1855007616077056:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074922.686474:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074922.686501:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074922.686515:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074922.686582:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e095200/0x557988ac98fe94b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a148 expref: 154 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074922.686598:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.686601:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.686609:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a14f expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.686620:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a14f expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.686664:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e094e00/0x557988ac98fe94b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a14f expref: 153 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074922.686683:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626619392:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074922.686768:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074922.694056:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626619392:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074922.694095:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074922.694166:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2420:x1855007616077056:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7708us (8370us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074922.694178:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1873 00000100:00100000:3.0:1769074922.698833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.698967:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077312 00000100:00100000:1.0:1769074922.698982:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077312 00000100:00100000:1.0:1769074922.699060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1858 00000100:00100000:1.0:1769074922.699072:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67330:x1855007616077312:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074922.699506:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67330:x1855007616077312:12345-192.168.204.32@tcp:35:cp.0 Request processed in 433us (699us total) trans 4294969004 rc 0/0 00000100:00100000:1.0:1769074922.699516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1858 00000100:00100000:3.0:1769074922.720229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.720367:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077440 00000100:00100000:0.0:1769074922.720382:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077440 00000100:00100000:0.0:1769074922.720465:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 149 00000100:00100000:0.0:1769074922.720476:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2420:x1855007616077440:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074922.720598:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.720626:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a156 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.720709:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.720728:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.720743:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.720759:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.720767:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.720773:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721133:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721143:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721149:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721156:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.721161:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721169:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721184:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.721188:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.721203:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721210:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe94c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721225:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721230:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721236:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721241:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.721245:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721255:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721263:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f3c6400) 00010000:00010000:0.0:1769074922.721265:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.721268:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721274:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe94cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.721314:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94bf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a156 expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.721324:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.721327:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074922.721331:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a156 expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.721340:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc -2) 00000100:00100000:0.0:1769074922.721513:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2420:x1855007616077440:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1037us (1725us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074922.721523:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 149 00000100:00100000:0.0:1769074922.744684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.744795:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077568 00000100:00100000:1.0:1769074922.744819:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077568 00000100:00100000:1.0:1769074922.744899:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9344 00000100:00100000:1.0:1769074922.744911:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67338:x1855007616077568:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074922.744939:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.744965:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe94d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a18e expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.745051:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.745068:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745080:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745094:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.745101:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745108:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745184:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745202:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745209:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745216:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745223:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.745228:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745236:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745251:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.745255:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.745260:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745266:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe94db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745283:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745289:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745294:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745299:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.745302:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745308:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745315:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f3d4100) 00010000:00010000:1.0:1769074922.745318:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.745320:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745326:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe94e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.745363:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe94d4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a18e expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.745373:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.745376:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.745379:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe94d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a18e expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.745388:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.745587:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67338:x1855007616077568:12345-192.168.204.32@tcp:101:bash.0 Request processed in 619us (860us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.745597:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9344 00000100:00100000:3.0:1769074922.758201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.758259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.758500:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077696 00000100:00100000:2.0:1769074922.758513:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077696 00000100:00100000:2.0:1769074922.758624:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9345 00000100:00100000:2.0:1769074922.758635:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67339:x1855007616077696:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074922.758659:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.758684:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe94e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a195 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.758767:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.758786:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758800:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758826:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.758833:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758840:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758905:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758912:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758917:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758924:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758929:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.758934:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758945:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758957:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.758960:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.758965:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758971:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe94f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758984:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758989:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758994:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.758999:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.759001:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.759007:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.759013:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f4df200) 00010000:00010000:2.0:1769074922.759015:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.759017:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.759022:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe94f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.759052:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe94e9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a195 expref: 362 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.759061:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.759064:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.759066:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe94e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a195 expref: 362 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.759074:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.759154:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67339:x1855007616077696:12345-192.168.204.32@tcp:101:rm.0 Request processed in 520us (977us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.759162:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9345 00000100:00100000:0.0:1769074922.760880:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077824 00000100:00100000:0.0:1769074922.760899:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077824 00000100:00100000:0.0:1769074922.761016:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 150 00000100:00100000:0.0:1769074922.761028:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2419:x1855007616077824:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074922.761072:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074922.761096:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94fe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a19c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.761165:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.761182:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761203:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761221:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074922.761228:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761234:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761289:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761296:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761303:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761309:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.761315:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761326:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761338:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.761341:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.761345:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761446:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9505 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761465:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761471:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761477:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761483:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074922.761486:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761964:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761975:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f3c6400) 00010000:00010000:0.0:1769074922.761978:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074922.761981:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.761986:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe950c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074922.762027:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94fe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a19c expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.762036:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074922.762038:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074922.762042:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe94fe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a19c expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.762049:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc -2) 00000100:00100000:0.0:1769074922.762144:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2419:x1855007616077824:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1117us (3883us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074922.762153:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 150 00000100:00100000:3.0:1769074922.766769:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.766898:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616077952 00000100:00100000:1.0:1769074922.766912:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616077952 00000100:00100000:1.0:1769074922.766981:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9346 00000100:00100000:1.0:1769074922.766993:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67339:x1855007616077952:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074922.767021:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.767049:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9513 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1a3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.767140:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.767157:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767171:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767187:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.767205:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767213:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767286:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767294:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767299:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767305:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767312:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.767316:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767324:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767337:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.767340:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.767346:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767361:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe951a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767379:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767384:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767390:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767395:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.767398:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767403:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767410:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f3d4100) 00010000:00010000:1.0:1769074922.767413:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.767416:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767421:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9521 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.767461:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9513 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1a3 expref: 362 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.767471:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.767474:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.767478:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9513 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1a3 expref: 362 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.767489:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.767615:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67339:x1855007616077952:12345-192.168.204.32@tcp:101:rm.0 Request processed in 623us (860us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.767624:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9346 00000100:00100000:3.0:1769074922.780778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.780918:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078080 00000100:00100000:2.0:1769074922.780932:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078080 00000100:00100000:2.0:1769074922.781015:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9347 00000100:00100000:2.0:1769074922.781027:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67340:x1855007616078080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.781056:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.781084:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9528 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1aa expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.781172:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.781200:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781213:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781235:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.781242:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781249:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781326:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781333:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781340:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781347:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781366:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.781371:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781380:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781394:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.781397:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.781402:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781409:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe952f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781425:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781431:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781437:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781442:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.781444:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781450:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781457:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f4df200) 00010000:00010000:2.0:1769074922.781460:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.781462:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781468:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9536 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.781502:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9528 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1aa expref: 362 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.781513:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.781515:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.781518:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9528 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1aa expref: 362 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.781596:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.781680:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67340:x1855007616078080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 655us (916us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.781688:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9347 00000100:00100000:3.0:1769074922.785458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.785811:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078208 00000100:00100000:1.0:1769074922.785826:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078208 00000100:00100000:1.0:1769074922.785900:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9348 00000100:00100000:1.0:1769074922.785911:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67340:x1855007616078208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.785938:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.785967:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe953d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1b1 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.786058:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.786077:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786090:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786107:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.786115:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786122:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786200:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786209:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786216:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786223:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786229:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.786234:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786242:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786255:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.786258:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.786265:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786270:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9544 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786284:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786290:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786295:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786299:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.786302:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786307:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786312:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f3d4100) 00010000:00010000:1.0:1769074922.786315:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.786317:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786322:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe954b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.786357:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe953d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1b1 expref: 362 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.786368:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.786371:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.786375:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe953d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1b1 expref: 362 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.786384:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.786470:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67340:x1855007616078208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 559us (1026us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.786479:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9348 00000100:00100000:3.0:1769074922.790722:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.790899:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078464 00000100:00100000:1.0:1769074922.790914:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078464 00000100:00100000:1.0:1769074922.790992:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9349 00000100:00100000:1.0:1769074922.791004:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67340:x1855007616078464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.791032:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.791060:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095c00/0x557988ac98fe9552 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1b8 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.791237:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.791255:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.791268:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.791283:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x38de1686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.791289:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.791295:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:1.0:1769074922.791718:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xaf:0x0], index 0: 0 00010000:00010000:1.0:1769074922.791931:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9567 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x168:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.791942:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9567 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.791949:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9567 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.791994:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792000:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792006:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792012:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792018:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.792023:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792031:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792044:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.792048:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.792053:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792064:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe9559 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:1.0:1769074922.792082:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000011f88d1 reply state 000000006641b105 transno 4294969005 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792092:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.792097:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f3d4d00) 00010000:00010000:1.0:1769074922.792100:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074922.792103:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074922.792140:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095c00/0x557988ac98fe9552 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1b8 expref: 364 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.792157:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095200/0x557988ac98fe9567 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x168:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1b8 expref: 363 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.792165:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x168:0x0].0x0 (ffff91604f185a00) 00010000:00010000:1.0:1769074922.792168:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074922.792171:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095200, rc 0) 00000100:00100000:1.0:1769074922.792276:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67340:x1855007616078464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1273us (1567us total) trans 4294969005 rc 0/0 00000100:00100000:1.0:1769074922.792285:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9349 00000100:00100000:3.0:1769074922.798006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.798102:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078592 00000100:00100000:1.0:1769074922.798117:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078592 00000100:00100000:1.0:1769074922.798201:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2691 00000100:00100000:1.0:1769074922.798214:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2418:x1855007616078592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.798238:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.798267:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1bf expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074922.798297:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074922.798323:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.798326:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.798337:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 155 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.798367:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 155 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.798383:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.798467:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2418:x1855007616078592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 254us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.798476:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2691 00000100:00100000:3.0:1769074922.802743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.802903:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078720 00000100:00100000:1.0:1769074922.802917:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078720 00000100:00100000:1.0:1769074922.802986:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2692 00000100:00100000:1.0:1769074922.802996:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:67340:x1855007616078720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.803019:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.803042:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1c6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.803081:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.803089:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.803092:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.803096:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1c6 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.803137:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.803153:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074922.803169:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626619520:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074922.803321:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1769074922.806831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.806945:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616078848 00000100:00100000:0.0:1769074922.806958:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616078848 00010000:00010000:0.0:1769074922.807027:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 157 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:0.0:1769074922.807077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1874 00000100:00100000:0.0:1769074922.807087:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2419:x1855007616078848:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074922.807107:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074922.807132:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 157 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074922.807148:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 157 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074922.807216:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.807219:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074922.807228:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1c6 expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.807247:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1c6 expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074922.807304:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1c6 expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074922.807321:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626619648:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074922.807442:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1769074922.807738:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e095000/0x557988ac98fe9575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1bf expref: 157 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074922.807757:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626619520:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074922.807785:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095c00/0x557988ac98fe957c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1c6 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.807795:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095c00, rc 0) 00000100:00100000:1.0:1769074922.807832:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:67340:x1855007616078720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4836us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.807840:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2692 00000100:00100000:0.0:1769074922.812323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.812495:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079104 00000100:00100000:3.0:1769074922.812509:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079104 00000100:00100000:3.0:1769074922.812617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1859 00000100:00100000:3.0:1769074922.812628:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67340:x1855007616079104:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074922.813025:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67340:x1855007616079104:12345-192.168.204.32@tcp:35:cp.0 Request processed in 398us (718us total) trans 4294969006 rc 0/0 00000100:00100000:3.0:1769074922.813035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1859 00000100:00100000:2.0:1769074922.813242:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626619648:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074922.813276:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074922.813305:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2419:x1855007616078848:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6220us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074922.813315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1874 00000100:00100000:3.0:1769074922.846649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.846769:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079232 00000100:00100000:2.0:1769074922.846783:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079232 00000100:00100000:2.0:1769074922.846869:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9350 00000100:00100000:2.0:1769074922.846881:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67343:x1855007616079232:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074922.846907:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.846933:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9583 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1cd expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.847021:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.847038:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847051:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847070:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.847076:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847083:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847150:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847157:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847164:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847171:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847178:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.847182:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847200:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847214:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.847218:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.847224:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847229:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe958a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847246:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847252:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847257:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847262:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.847270:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847275:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847283:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f4df200) 00010000:00010000:2.0:1769074922.847286:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.847289:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847296:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9591 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.847333:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9583 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1cd expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.847344:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.847347:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.847351:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe9583 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1cd expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.847366:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fe00, rc 0) 00000100:00100000:2.0:1769074922.847452:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67343:x1855007616079232:12345-192.168.204.32@tcp:101:bash.0 Request processed in 573us (817us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.847465:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9350 00000100:00100000:0.0:1769074922.865664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074922.865728:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.865830:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079360 00000100:00100000:1.0:1769074922.865844:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079360 00000100:00100000:1.0:1769074922.865916:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9351 00000100:00100000:1.0:1769074922.865927:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67344:x1855007616079360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074922.865960:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.865988:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9598 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1d4 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.866072:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.866091:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866104:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866120:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.866127:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866133:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866219:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866226:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866231:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866237:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866243:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.866249:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866257:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866272:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.866276:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.866282:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866289:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe959f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866312:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866318:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866324:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866329:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.866331:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866337:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866343:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f185f00) 00010000:00010000:1.0:1769074922.866346:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.866348:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866359:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.866392:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9598 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1d4 expref: 366 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.866402:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.866404:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.866408:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe9598 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1d4 expref: 366 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.866417:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.866506:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67344:x1855007616079360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 580us (854us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.866514:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9351 00000100:00100000:3.0:1769074922.866860:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079488 00000100:00100000:3.0:1769074922.866868:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079488 00000100:00100000:3.0:1769074922.866911:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:3.0:1769074922.866918:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2420:x1855007616079488:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074922.866944:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.866956:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe95ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1db expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.866992:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.867007:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867015:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867028:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074922.867035:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867041:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867072:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867078:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867084:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867089:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.867093:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867099:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867108:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.867110:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.867113:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867119:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe95b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867129:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867134:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867140:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867145:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.867147:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867152:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867157:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff916052a0c200) 00010000:00010000:3.0:1769074922.867159:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.867161:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867166:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe95bb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074922.867198:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe95ad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1db expref: 366 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.867207:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.867210:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074922.867214:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe95ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1db expref: 366 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.867223:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc -2) 00000100:00100000:3.0:1769074922.867280:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2420:x1855007616079488:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 362us (1551us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074922.867287:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:0.0:1769074922.871863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.871974:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079616 00000100:00100000:2.0:1769074922.871989:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079616 00000100:00100000:2.0:1769074922.872063:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9352 00000100:00100000:2.0:1769074922.872075:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67344:x1855007616079616:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074922.872101:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.872126:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1e2 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.872223:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.872243:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872256:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872275:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.872281:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872288:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872365:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872373:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872379:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872386:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872393:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.872398:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872407:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872420:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.872424:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.872429:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872437:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872454:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872459:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872464:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872470:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.872473:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872479:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872486:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f4df200) 00010000:00010000:2.0:1769074922.872488:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.872490:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872496:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95d0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.872587:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95c2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1e2 expref: 366 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.872599:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.872601:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.872605:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1e2 expref: 366 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.872615:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074922.872690:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67344:x1855007616079616:12345-192.168.204.32@tcp:101:rm.0 Request processed in 617us (841us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.872699:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9352 00000100:00100000:0.0:1769074922.887866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.887990:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079744 00000100:00100000:1.0:1769074922.888004:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079744 00000100:00100000:1.0:1769074922.888083:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9353 00000100:00100000:1.0:1769074922.888095:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67345:x1855007616079744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.888124:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.888151:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe95d7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1e9 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.888250:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.888268:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888286:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888303:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074922.888311:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888317:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888404:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888412:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888418:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888424:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888430:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.888434:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888444:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888459:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.888463:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.888469:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888475:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe95de lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888507:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888514:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888519:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888524:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.888527:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888609:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888617:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f185f00) 00010000:00010000:1.0:1769074922.888620:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.888623:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888628:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094200/0x557988ac98fe95e5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074922.888666:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe95d7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1e9 expref: 366 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.888677:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.888681:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.888684:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe95d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1e9 expref: 366 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.888693:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.888766:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67345:x1855007616079744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 673us (915us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074922.888774:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9353 00000100:00100000:0.0:1769074922.896666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.896772:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616079872 00000100:00100000:2.0:1769074922.896786:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616079872 00000100:00100000:2.0:1769074922.896874:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9354 00000100:00100000:2.0:1769074922.896886:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67345:x1855007616079872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.896913:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.896941:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1f0 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.897031:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.897048:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897061:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897075:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.897081:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897087:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897154:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897162:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897168:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897175:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897181:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.897197:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897205:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897220:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.897224:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.897229:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897236:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe95f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897252:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897258:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897263:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897268:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.897271:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897277:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897284:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f4df200) 00010000:00010000:2.0:1769074922.897287:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.897290:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897295:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe95fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.897331:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95ec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1f0 expref: 366 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.897341:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.897344:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.897492:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe95ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1f0 expref: 366 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.897506:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074922.897767:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67345:x1855007616079872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 882us (1113us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.897776:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9354 00000100:00100000:0.0:1769074922.903171:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.903298:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080128 00000100:00100000:2.0:1769074922.903312:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080128 00000100:00100000:2.0:1769074922.903522:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9355 00000100:00100000:2.0:1769074922.903559:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67345:x1855007616080128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074922.903587:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.903614:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9601 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1f7 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.903768:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.903785:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.903812:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.903829:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa790c23e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.903836:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.903843:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074922.904254:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb0:0x0], index 1: 0 00010000:00010000:2.0:1769074922.904459:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9616 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x169:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.904470:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9616 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904478:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9616 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904520:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904563:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904572:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904580:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904592:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.904597:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904605:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904620:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.904624:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.904630:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904636:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9608 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074922.904654:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001ad9f5cf reply state 000000007ef43e6e transno 4294969007 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904665:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.904671:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f4df800) 00010000:00010000:2.0:1769074922.904674:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074922.904677:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074922.904715:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9601 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1f7 expref: 368 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.904732:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e800/0x557988ac98fe9616 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1f7 expref: 367 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.904741:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x169:0x0].0x0 (ffff91604f4dfa00) 00010000:00010000:2.0:1769074922.904744:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074922.904747:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e800, rc 0) 00000100:00100000:2.0:1769074922.904842:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67345:x1855007616080128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1308us (1685us total) trans 4294969007 rc 0/0 00000100:00100000:2.0:1769074922.904851:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9355 00000100:00100000:0.0:1769074922.908732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.909409:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080256 00000100:00100000:1.0:1769074922.909426:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080256 00000100:00100000:1.0:1769074922.909513:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2693 00000100:00100000:1.0:1769074922.909526:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+153:2420:x1855007616080256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.909584:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.909614:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a1fe expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074922.909646:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074922.909672:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.909675:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.909686:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 154 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.909707:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 154 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.909723:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074922.910207:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2420:x1855007616080256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 681us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.910222:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2693 00000100:00100000:0.0:1769074922.921394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.921523:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080384 00000100:00100000:1.0:1769074922.921579:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080384 00000100:00100000:1.0:1769074922.921659:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2694 00000100:00100000:1.0:1769074922.921671:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:67345:x1855007616080384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074922.921696:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.921720:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a205 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.921764:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 155 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.921773:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.921775:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074922.921780:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a205 expref: 155 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.921837:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 155 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074922.921855:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 155 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074922.921872:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626619776:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074922.922004:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1769074922.926835:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.927091:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080512 00000100:00100000:2.0:1769074922.927104:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080512 00010000:00010000:2.0:1769074922.927173:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 156 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:2.0:1769074922.927236:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1875 00000100:00100000:2.0:1769074922.927247:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616080512:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074922.927266:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074922.927293:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 156 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:2.0:1769074922.927310:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 156 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:2.0:1769074922.927342:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.927345:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074922.927487:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a205 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.927509:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a205 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.927599:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a205 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074922.927618:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626619904:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074922.927715:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160429eee40 going to sleep for 11 seconds 00010000:00010000:1.0:1769074922.928324:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe9624 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a1fe expref: 156 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074922.928344:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626619776:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074922.928385:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e094200/0x557988ac98fe962b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a205 expref: 155 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.928397:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094200, rc 0) 00000100:00100000:1.0:1769074922.928453:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:67345:x1855007616080384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6784us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074922.928463:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2694 00000100:00100000:2.0:1769074922.932519:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626619904:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074922.932699:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074922.938761:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2419:x1855007616080512:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 11496us (11923us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074922.938783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1875 00000100:00100000:0.0:1769074922.939082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.939309:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080768 00000100:00100000:3.0:1769074922.939324:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080768 00000100:00100000:3.0:1769074922.939398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1860 00000100:00100000:3.0:1769074922.939410:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916148471c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67345:x1855007616080768:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074922.941322:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916148471c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67345:x1855007616080768:12345-192.168.204.32@tcp:35:cp.0 Request processed in 1895us (2223us total) trans 4294969008 rc 0/0 00000100:00100000:3.0:1769074922.941340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1860 00000100:00100000:0.0:1769074922.982504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074922.982708:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616080896 00000100:00100000:2.0:1769074922.982723:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616080896 00000100:00100000:2.0:1769074922.982814:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9356 00000100:00100000:2.0:1769074922.982827:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67348:x1855007616080896:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074922.982856:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074922.982883:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9632 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a20c expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.982971:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.982989:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983003:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983018:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074922.983024:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983032:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983104:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983112:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983119:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983127:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983134:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.983139:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983147:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983161:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.983164:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.983170:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983176:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9639 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983200:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983207:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983214:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983219:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074922.983222:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983228:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983235:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff91604f4df200) 00010000:00010000:2.0:1769074922.983237:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.983240:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983245:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9640 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074922.983279:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9632 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a20c expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.983289:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074922.983291:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074922.983294:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9632 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a20c expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074922.983307:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f800, rc 0) 00000100:00100000:2.0:1769074922.983389:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67348:x1855007616080896:12345-192.168.204.32@tcp:101:bash.0 Request processed in 565us (913us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074922.983398:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9356 00000100:00100000:1.0:1769074922.991643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074922.991819:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081024 00000100:00100000:3.0:1769074922.991833:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081024 00000100:00100000:3.0:1769074922.991911:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9357 00000100:00100000:3.0:1769074922.991923:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67349:x1855007616081024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074922.991957:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.991984:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9647 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a213 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.992067:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074922.992086:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992105:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992121:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074922.992128:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992134:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992215:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992224:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992232:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992239:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992246:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.992250:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992259:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992274:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.992277:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.992284:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992290:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe964e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992305:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992311:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992317:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992322:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074922.992324:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992328:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992334:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff916052a0c200) 00010000:00010000:3.0:1769074922.992337:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.992339:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992345:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9655 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074922.992814:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9647 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a213 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.992827:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074922.992830:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074922.992834:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9647 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a213 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074922.992843:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:3.0:1769074922.992933:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67349:x1855007616081024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1012us (1305us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074922.992941:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9357 00000100:00100000:0.0:1769074922.997640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.997736:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081152 00000100:00100000:1.0:1769074922.997754:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081152 00000100:00100000:1.0:1769074922.997847:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 152 00000100:00100000:1.0:1769074922.997861:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2419:x1855007616081152:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074922.997941:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074922.997969:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe965c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a21a expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.998049:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.998069:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998085:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998102:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074922.998110:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998116:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998200:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998211:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998217:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998223:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.998228:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998236:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998251:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.998254:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.998260:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998265:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9663 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998280:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998286:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998293:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998298:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074922.998301:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998306:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998313:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f185300) 00010000:00010000:1.0:1769074922.998315:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074922.998317:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998323:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe966a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074922.998373:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe965c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a21a expref: 370 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.998383:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074922.998386:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074922.998390:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe965c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a21a expref: 370 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074922.998399:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc -2) 00000100:00100000:0.0:1769074922.999096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074922.999346:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2419:x1855007616081152:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1482us (1708us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074922.999369:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 152 00000100:00100000:3.0:1769074922.999394:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081280 00000100:00100000:3.0:1769074922.999406:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081280 00000100:00100000:3.0:1769074922.999476:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9358 00000100:00100000:3.0:1769074922.999486:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67349:x1855007616081280:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074922.999507:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074922.999856:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9671 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a252 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.000361:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.000376:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000386:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000400:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.000405:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000411:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000465:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000473:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000478:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000484:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000490:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.000494:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000501:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.000513:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.000517:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.000522:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001022:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9678 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001041:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001051:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001057:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001062:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.001065:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001070:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001080:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff916052af8500) 00010000:00010000:3.0:1769074923.001082:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.001085:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001089:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe967f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.001241:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9671 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a252 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.001254:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.001257:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.001260:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe9671 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a252 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.001270:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:3.0:1769074923.001414:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67349:x1855007616081280:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1927us (2324us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.001422:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9358 00000100:00100000:0.0:1769074923.022932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.025356:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081408 00000100:00100000:3.0:1769074923.025377:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081408 00000100:00100000:3.0:1769074923.025794:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9359 00000100:00100000:3.0:1769074923.025816:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67352:x1855007616081408:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.025843:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.025871:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9686 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a259 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.025958:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.025976:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.025989:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026005:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.026013:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026021:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026088:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026096:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026103:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026111:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026119:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.026125:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026134:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026284:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.026290:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.026298:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000100:00100000:0.0:1769074923.026310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1769074923.026313:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe968d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026343:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00000100:00100000:0.0:1769074923.026359:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081536 00010000:00010000:3.0:1769074923.026359:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00000100:00100000:0.0:1769074923.026370:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081536 00010000:00010000:3.0:1769074923.026374:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026382:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.026385:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026397:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026408:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff916052af8500) 00010000:00010000:3.0:1769074923.026412:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.026424:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.026431:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9694 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000100:00100000:0.0:1769074923.026441:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 153 00000100:00100000:0.0:1769074923.026459:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:2419:x1855007616081536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074923.026497:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9686 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a259 expref: 371 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.026510:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.026513:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.026522:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.026528:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb400/0x557988ac98fe9686 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a259 expref: 371 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.026569:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe969b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a260 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.026596:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc 0) 00010000:00010000:0.0:1769074923.026627:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.026643:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026654:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026668:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.026675:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026681:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026746:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026754:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026763:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026779:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.026783:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026791:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026803:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.026806:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.026812:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026818:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026833:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026839:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026844:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026850:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.026853:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026860:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026873:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f3c6400) 00010000:00010000:0.0:1769074923.026875:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.026878:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026883:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.026911:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe969b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a260 expref: 371 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.026921:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.026923:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074923.026927:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe969b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a260 expref: 371 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.026936:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc -2) 00000100:00100000:0.0:1769074923.027013:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+370:2419:x1855007616081536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 557us (719us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074923.027022:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 153 00000100:00080000:2.0:1769074923.030510:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074923.032772:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67352:x1855007616081408:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6942us (9833us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.032788:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9359 00000100:00100000:1.0:1769074923.036240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.036865:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081664 00000100:00100000:2.0:1769074923.036879:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081664 00000100:00100000:2.0:1769074923.036981:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9360 00000100:00100000:2.0:1769074923.036993:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67352:x1855007616081664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.037019:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.037045:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe96b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a298 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.037127:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.037143:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037166:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037192:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.037200:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037206:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037272:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037279:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037286:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037294:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037301:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.037306:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037313:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037326:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.037329:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.037335:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037341:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe96b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037367:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037373:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037380:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037384:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.037387:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037392:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037403:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff91604f4df200) 00010000:00010000:2.0:1769074923.037405:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.037407:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037413:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe96be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.037447:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe96b0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a298 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.037457:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.037459:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.037463:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe96b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a298 expref: 370 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.037472:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f800, rc 0) 00000100:00100000:2.0:1769074923.037589:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67352:x1855007616081664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 597us (1361us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.037596:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9360 00000100:00100000:0.0:1769074923.043623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.043758:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616081920 00000100:00100000:2.0:1769074923.043774:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616081920 00000100:00100000:2.0:1769074923.043857:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9361 00000100:00100000:2.0:1769074923.043869:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67352:x1855007616081920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.043899:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.043926:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe96c5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a29f expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.044083:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.044098:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.044112:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.044127:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.044133:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.044140:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074923.045018:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb0:0x0], index 0: 0 00010000:00010000:2.0:1769074923.045229:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe96da lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.045243:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe96da lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045253:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe96da lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045292:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045300:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045313:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045321:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045327:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.045332:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.045340:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.046981:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.046986:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.046994:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.047004:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe96cc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074923.047024:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017f6cd4a reply state 00000000ec9771bf transno 4294969009 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.047039:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.047045:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff91604f4df400) 00010000:00010000:2.0:1769074923.047047:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074923.047052:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074923.047956:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe96c5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a29f expref: 372 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.047987:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f400/0x557988ac98fe96da lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a29f expref: 371 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.047996:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16a:0x0].0x0 (ffff91604f4dfe00) 00010000:00010000:3.0:1769074923.047999:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074923.048002:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f400, rc 0) 00000100:00100000:3.0:1769074923.048169:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67352:x1855007616081920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4299us (4569us total) trans 4294969009 rc 0/0 00000100:00100000:3.0:1769074923.048180:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9361 00000100:00100000:0.0:1769074923.052886:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.053011:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082048 00000100:00100000:1.0:1769074923.053025:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082048 00000100:00100000:1.0:1769074923.053146:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2695 00000100:00100000:1.0:1769074923.053159:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2419:x1855007616082048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.053193:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.053222:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2a6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.053254:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.053281:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.053284:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.053294:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 156 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.053316:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 156 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.053332:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095a00, rc 0) 00000100:00100000:1.0:1769074923.053422:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616082048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 266us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.053431:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2695 00000100:00080000:2.0:1769074923.055381:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074923.057340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.057445:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082176 00000100:00100000:3.0:1769074923.057458:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082176 00000100:00100000:3.0:1769074923.057527:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2696 00000100:00100000:3.0:1769074923.057588:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:67352:x1855007616082176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.057612:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.057638:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2ad expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.057681:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.057690:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.057693:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.057698:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ad expref: 157 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.057742:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.057757:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:3.0:1769074923.057773:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626620032:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074923.057909:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916149131240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074923.060791:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626620032:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074923.060855:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ad expref: 157 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.060879:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb400, rc 0) 00000100:00100000:3.0:1769074923.061111:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:67352:x1855007616082176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3523us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074923.061122:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2696 00000100:00100000:2.0:1769074923.064764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.064888:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082304 00000100:00100000:0.0:1769074923.064902:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082304 00010000:00010000:0.0:1769074923.064970:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:0.0:1769074923.065020:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1876 00000100:00100000:0.0:1769074923.065032:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2419:x1855007616082304:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074923.065049:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074923.065074:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074923.065087:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074923.065117:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe96e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2a6 expref: 157 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074923.065135:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.065137:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.065145:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ad expref: 156 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.065156:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ad expref: 156 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.065211:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052adb400/0x557988ac98fe96ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ad expref: 156 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074923.065227:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626620160:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074923.065339:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074923.069400:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626620160:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074923.069439:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074923.069579:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616082304:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4496us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.069595:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1876 00000100:00100000:1.0:1769074923.070963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.071115:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082560 00000100:00100000:3.0:1769074923.071128:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082560 00000100:00100000:3.0:1769074923.071206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1861 00000100:00100000:3.0:1769074923.071217:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67352:x1855007616082560:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074923.071848:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67352:x1855007616082560:12345-192.168.204.32@tcp:35:cp.0 Request processed in 628us (892us total) trans 4294969010 rc 0/0 00000100:00100000:3.0:1769074923.071859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1861 00000100:00100000:2.0:1769074923.108451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.108498:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.108604:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082688 00000100:00100000:0.0:1769074923.108618:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082688 00000100:00100000:0.0:1769074923.108701:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 154 00000100:00100000:0.0:1769074923.108712:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2417:x1855007616082688:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074923.108780:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.108816:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96f6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2b4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.108887:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.108905:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.108917:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.108933:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.108940:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.108946:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109013:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109019:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109027:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109034:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.109038:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109045:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109058:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.109062:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.109066:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109072:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe96fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109087:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109093:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109098:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109103:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.109105:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109110:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109121:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f3c6400) 00010000:00010000:0.0:1769074923.109124:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.109127:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109132:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9704 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.109166:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96f6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2b4 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.109176:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.109178:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074923.109181:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe96f6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2b4 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.109202:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc -2) 00000100:00100000:0.0:1769074923.109283:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2417:x1855007616082688:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 573us (845us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074923.109292:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 154 00000100:00100000:3.0:1769074923.110153:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082816 00000100:00100000:3.0:1769074923.110166:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082816 00000100:00100000:3.0:1769074923.110262:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9362 00000100:00100000:3.0:1769074923.110273:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67359:x1855007616082816:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074923.110294:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.110318:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe970b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2ec expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.110403:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.110420:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110434:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110451:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.110458:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110466:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110523:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110703:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110711:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110717:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110723:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.110729:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110736:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110749:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.110753:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.110757:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110764:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9712 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110781:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110787:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.110792:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00000100:00080000:0.0:1769074923.110943:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1769074923.111035:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.111039:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.111045:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.111054:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff916052af8500) 00010000:00010000:3.0:1769074923.111057:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.111060:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.111066:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9719 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.111107:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe970b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ec expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.111117:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.111120:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.111124:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe970b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2ec expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.111134:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:3.0:1769074923.111229:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67359:x1855007616082816:12345-192.168.204.32@tcp:101:bash.0 Request processed in 958us (2729us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.111238:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9362 00000100:00100000:1.0:1769074923.124460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.124702:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616082944 00000100:00100000:2.0:1769074923.124715:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616082944 00000100:00100000:2.0:1769074923.124791:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9363 00000100:00100000:2.0:1769074923.124810:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67360:x1855007616082944:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074923.124835:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.124861:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9720 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2f3 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.124942:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.124958:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.124970:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.124985:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.124992:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.124998:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125061:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125067:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125073:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125080:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125086:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.125091:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125100:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125114:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.125117:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.125122:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125127:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9727 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125145:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125150:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125156:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125160:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.125163:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125168:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125178:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f4df200) 00010000:00010000:2.0:1769074923.125180:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.125193:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125199:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe972e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.125233:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9720 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2f3 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.125243:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.125245:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.125249:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9720 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2f3 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.125258:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074923.125335:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67360:x1855007616082944:12345-192.168.204.32@tcp:101:rm.0 Request processed in 527us (890us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.125489:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9363 00000100:00100000:2.0:1769074923.129469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.129770:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083072 00000100:00100000:1.0:1769074923.129785:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083072 00000100:00100000:1.0:1769074923.129874:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00100000:1.0:1769074923.129885:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616083072:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074923.129935:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.129963:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9735 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a2fa expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.130038:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.130056:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130069:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130084:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.130090:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130095:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130167:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130174:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130181:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130199:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.130204:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130212:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130227:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.130231:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.130235:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130241:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095000/0x557988ac98fe973c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130257:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130262:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130267:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130272:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.130274:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130279:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130286:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f185900) 00010000:00010000:1.0:1769074923.130288:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.130292:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130297:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9743 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.130334:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9735 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2fa expref: 374 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.130357:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.130360:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074923.130364:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9735 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a2fa expref: 374 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.130374:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc -2) 00000100:00100000:1.0:1769074923.130714:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616083072:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 829us (1258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074923.130724:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00100000:1.0:1769074923.137934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.138140:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083200 00000100:00100000:2.0:1769074923.138172:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083200 00000100:00100000:2.0:1769074923.138339:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9364 00000100:00100000:2.0:1769074923.138359:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67360:x1855007616083200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074923.138392:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.138415:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe974a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a301 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.138593:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.138624:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138637:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138670:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.138678:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138685:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138751:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138756:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138760:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138764:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138769:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.138772:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138780:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138790:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.138803:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.138809:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138815:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9751 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138832:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138838:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138843:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138848:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.138851:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138857:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138864:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f4df200) 00010000:00010000:2.0:1769074923.138866:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.138869:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138874:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe9758 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.138912:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe974a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a301 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.138923:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.138925:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.138928:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe974a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a301 expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.138936:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074923.139012:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67360:x1855007616083200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 666us (1096us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.139018:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9364 00000100:00100000:2.0:1769074923.159707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.160000:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083328 00000100:00100000:3.0:1769074923.160014:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083328 00000100:00100000:3.0:1769074923.160094:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9365 00000100:00100000:3.0:1769074923.160106:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67361:x1855007616083328:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.160136:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.160165:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe975f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a308 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.160273:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.160291:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160305:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160320:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.160327:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160370:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160476:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160484:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160510:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160606:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160613:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.160618:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160640:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160656:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.160660:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.160666:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160672:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9766 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160689:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160694:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160701:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160706:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.160709:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160715:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160726:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff916052af8500) 00010000:00010000:3.0:1769074923.160728:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.160731:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160737:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe976d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.160775:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe975f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a308 expref: 374 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.160786:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.160789:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.160792:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe975f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a308 expref: 374 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.160814:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:3.0:1769074923.160899:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67361:x1855007616083328:12345-192.168.204.32@tcp:101:cp.0 Request processed in 795us (1222us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.160908:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9365 00000100:00100000:0.0:1769074923.165163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.165291:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083456 00000100:00100000:2.0:1769074923.165305:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083456 00000100:00100000:2.0:1769074923.165393:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9366 00000100:00100000:2.0:1769074923.165404:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67361:x1855007616083456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.165431:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.165459:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9774 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a30f expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.165597:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.165617:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165630:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165650:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.165657:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165664:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165735:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165743:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165750:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165755:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165759:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.165763:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165769:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165779:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.165782:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.165786:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165790:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe977b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165808:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165814:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165820:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165825:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.165827:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165833:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165840:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff91604f4df200) 00010000:00010000:2.0:1769074923.165842:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.165845:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165851:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9782 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.165881:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9774 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a30f expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.165889:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.165891:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.165893:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9774 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a30f expref: 374 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.165903:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:2.0:1769074923.165976:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67361:x1855007616083456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 574us (828us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.165982:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9366 00000100:00100000:1.0:1769074923.170232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.170339:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083712 00000100:00100000:3.0:1769074923.170364:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083712 00000100:00100000:3.0:1769074923.170436:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9367 00000100:00100000:3.0:1769074923.170448:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67361:x1855007616083712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.170477:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.170515:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9789 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a316 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.170731:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.170748:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.170762:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.170778:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.170784:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.170790:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:3.0:1769074923.171221:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb1:0x0], index 1: 0 00010000:00010000:3.0:1769074923.171420:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe979e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.171433:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe979e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171441:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe979e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171484:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171492:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171504:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171512:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171518:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.171523:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171561:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171576:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.171579:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.171585:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171590:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9790 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:3.0:1769074923.171605:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e49efd13 reply state 000000009bd299c6 transno 4294969011 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171617:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.171623:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff916052af8500) 00010000:00010000:3.0:1769074923.171626:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074923.171629:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074923.171669:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9789 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a316 expref: 376 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.171689:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14c00/0x557988ac98fe979e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a316 expref: 375 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.171697:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16b:0x0].0x0 (ffff916052af8c00) 00010000:00010000:3.0:1769074923.171700:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074923.171703:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14c00, rc 0) 00000100:00100000:3.0:1769074923.171785:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67361:x1855007616083712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1338us (1567us total) trans 4294969011 rc 0/0 00000100:00100000:3.0:1769074923.171795:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9367 00000100:00100000:1.0:1769074923.179895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.180062:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083840 00000100:00100000:3.0:1769074923.180077:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083840 00000100:00100000:3.0:1769074923.180173:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2697 00000100:00100000:3.0:1769074923.180197:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+154:2419:x1855007616083840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.180221:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.180249:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a31d expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074923.180279:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074923.180303:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.180306:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.180316:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 155 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.180336:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 155 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.180369:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:3.0:1769074923.180459:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2419:x1855007616083840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 275us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074923.180468:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2697 00000100:00080000:0.0:1769074923.180672:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1769074923.184429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.184567:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616083968 00000100:00100000:1.0:1769074923.184580:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616083968 00000100:00100000:1.0:1769074923.184661:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2698 00000100:00100000:1.0:1769074923.184673:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:67361:x1855007616083968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.184697:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.184730:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a324 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.184780:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.184790:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.184792:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.184796:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a324 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.184850:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.184866:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.184888:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626620288:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074923.185051:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9900 going to sleep for 11 seconds 00000100:00100000:1.0:1769074923.188223:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626620288:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074923.188273:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a324 expref: 156 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.188300:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095000, rc 0) 00000100:00100000:1.0:1769074923.188443:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:67361:x1855007616083968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3771us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.188454:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2698 00000100:00100000:0.0:1769074923.191156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.191320:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084096 00000100:00100000:1.0:1769074923.191335:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084096 00010000:00010000:1.0:1769074923.191419:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.191467:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1877 00000100:00100000:1.0:1769074923.191477:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2420:x1855007616084096:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074923.191506:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074923.191559:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.191576:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.191604:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98fe97ac lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a31d expref: 156 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.191623:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.191625:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.191634:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a324 expref: 155 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.191644:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a324 expref: 155 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.191688:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095000/0x557988ac98fe97b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a324 expref: 155 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074923.191702:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626620416:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074923.191808:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1769074923.198103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.198207:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084352 00000100:00100000:3.0:1769074923.198220:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084352 00000100:00100000:3.0:1769074923.198296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1862 00000100:00100000:3.0:1769074923.198308:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67361:x1855007616084352:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074923.198766:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67361:x1855007616084352:12345-192.168.204.32@tcp:35:cp.0 Request processed in 457us (676us total) trans 4294969012 rc 0/0 00000100:00100000:3.0:1769074923.198776:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1862 00000100:00100000:1.0:1769074923.206601:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626620416:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074923.206646:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074923.206740:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2420:x1855007616084096:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 15263us (15598us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.206754:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1877 00000100:00100000:2.0:1769074923.239219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.239339:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084480 00000100:00100000:1.0:1769074923.239364:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084480 00000100:00100000:1.0:1769074923.239485:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9368 00000100:00100000:1.0:1769074923.239513:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67366:x1855007616084480:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074923.239589:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.239618:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a32b expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.239707:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.239726:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239741:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239759:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.239766:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239772:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239849:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239857:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239863:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239870:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239875:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.239880:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239887:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239903:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.239906:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.239912:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239918:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe97c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239936:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239942:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239948:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239953:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.239956:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239962:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239968:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185900) 00010000:00010000:1.0:1769074923.239971:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.239974:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.239979:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.240018:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97ba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a32b expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.240028:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.240030:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.240033:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a32b expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.240042:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094c00, rc 0) 00000100:00100000:1.0:1769074923.240112:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67366:x1855007616084480:12345-192.168.204.32@tcp:101:bash.0 Request processed in 602us (907us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.240121:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9368 00000100:00100000:3.0:1769074923.252808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.252932:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084608 00000100:00100000:1.0:1769074923.252946:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084608 00000100:00100000:1.0:1769074923.253015:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9369 00000100:00100000:1.0:1769074923.253027:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67367:x1855007616084608:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074923.253064:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.253090:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe97cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a332 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.253175:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.253203:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253215:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253234:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.253240:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253246:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253317:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253323:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253328:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253335:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253340:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.253356:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253364:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253378:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.253381:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.253386:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253392:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe97d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253414:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253420:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253425:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253430:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.253432:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253438:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253444:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185600) 00010000:00010000:1.0:1769074923.253446:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.253449:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253458:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe97dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.253493:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe97cf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a332 expref: 378 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.253504:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.253505:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.253509:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe97cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a332 expref: 378 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.253519:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074923.253638:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67367:x1855007616084608:12345-192.168.204.32@tcp:101:rm.0 Request processed in 612us (856us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.253648:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9369 00000100:00100000:0.0:1769074923.257336:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.257450:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084736 00000100:00100000:1.0:1769074923.257465:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084736 00000100:00100000:1.0:1769074923.257579:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 156 00000100:00100000:1.0:1769074923.257591:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2418:x1855007616084736:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074923.257663:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.257689:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe97e4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a339 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.257766:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.257785:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257803:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257820:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.257827:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257833:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257901:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257909:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257916:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257923:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.257927:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257936:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257949:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.257953:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.257959:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257966:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe97eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257985:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257992:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.257998:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.258003:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.258005:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.258011:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.258018:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f185900) 00010000:00010000:1.0:1769074923.258021:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.258024:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.258029:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe97f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.258064:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe97e4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a339 expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.258075:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.258078:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074923.258081:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe97e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a339 expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.258097:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc -2) 00000100:00100000:1.0:1769074923.258180:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2418:x1855007616084736:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 590us (859us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074923.258200:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 156 00000100:00100000:2.0:1769074923.266002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.266153:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084864 00000100:00100000:3.0:1769074923.266167:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084864 00000100:00100000:3.0:1769074923.266252:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9370 00000100:00100000:3.0:1769074923.266264:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67367:x1855007616084864:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074923.266292:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.266321:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe97f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a371 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.266421:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.266440:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266458:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266474:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.266481:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266487:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266819:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266827:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266834:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266841:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266847:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.266851:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266859:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266873:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.266876:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.266882:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266888:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9800 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266903:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266909:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266915:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266920:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.266923:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266928:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266934:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff916052af8400) 00010000:00010000:3.0:1769074923.266937:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.266939:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266944:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9807 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.266982:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe97f9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a371 expref: 378 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.266992:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.266995:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.266999:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe97f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a371 expref: 378 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.267008:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:3.0:1769074923.267077:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67367:x1855007616084864:12345-192.168.204.32@tcp:101:rm.0 Request processed in 815us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.267085:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9370 00000100:00100000:3.0:1769074923.284662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.284719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.284836:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085120 00000100:00100000:0.0:1769074923.284849:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085120 00000100:00100000:0.0:1769074923.284925:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 157 00000100:00100000:0.0:1769074923.284937:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616085120:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074923.285011:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.285038:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe980e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a37f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.285114:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.285132:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285144:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285161:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074923.285168:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285174:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285259:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285268:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285275:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285281:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.285286:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285295:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285310:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.285314:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.285321:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285326:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe9815 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285342:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285349:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285355:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285360:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.285363:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285369:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285376:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f3c6400) 00010000:00010000:0.0:1769074923.285379:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.285382:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285389:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe981c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074923.285424:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe980e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a37f expref: 378 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.285436:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.285439:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074923.285443:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe980e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a37f expref: 378 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.285453:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc -2) 00000100:00100000:0.0:1769074923.285583:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616085120:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 646us (861us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074923.285592:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 157 00000100:00100000:1.0:1769074923.285882:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616084992 00000100:00100000:1.0:1769074923.285890:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616084992 00000100:00100000:1.0:1769074923.285940:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9371 00000100:00100000:1.0:1769074923.285948:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67370:x1855007616084992:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.285962:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.285977:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9823 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a378 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.286022:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.286033:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286041:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286055:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.286062:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286068:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286108:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286115:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286122:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286128:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286133:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.286138:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286144:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286153:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.286156:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.286160:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286166:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe982a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286190:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286196:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286203:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286209:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.286212:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286218:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286226:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185900) 00010000:00010000:1.0:1769074923.286228:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.286231:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286236:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe9831 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.286260:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9823 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a378 expref: 378 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.286268:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.286271:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.286275:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9823 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a378 expref: 378 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.286284:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094800, rc 0) 00000100:00100000:1.0:1769074923.286327:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67370:x1855007616084992:12345-192.168.204.32@tcp:101:cp.0 Request processed in 380us (1682us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.286333:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9371 00000100:00100000:0.0:1769074923.291475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.291664:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085248 00000100:00100000:1.0:1769074923.291679:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085248 00000100:00100000:1.0:1769074923.291757:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9372 00000100:00100000:1.0:1769074923.291769:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67370:x1855007616085248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.291809:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.291838:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9838 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a3b7 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.291927:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.291945:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.291958:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.291979:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.291986:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.291992:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292065:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292072:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292078:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292084:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292091:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.292095:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292104:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292118:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.292122:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.292127:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292132:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe983f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292150:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292156:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292161:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292166:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b4b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.292169:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292175:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292192:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185600) 00010000:00010000:1.0:1769074923.292195:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.292199:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292204:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9846 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.292240:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9838 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3b7 expref: 378 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.292249:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.292252:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.292255:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9838 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3b7 expref: 378 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.292270:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074923.292353:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67370:x1855007616085248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 586us (892us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.292361:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9372 00000100:00100000:3.0:1769074923.296483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.296657:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085504 00000100:00100000:1.0:1769074923.296670:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085504 00000100:00100000:1.0:1769074923.296738:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9373 00000100:00100000:1.0:1769074923.296749:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67370:x1855007616085504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.296775:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.296813:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe984d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a3be expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.296980:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.296997:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297011:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297028:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x18290d53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.297035:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297042:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:1.0:1769074923.297457:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb1:0x0], index 0: 0 00010000:00010000:1.0:1769074923.297690:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe9862 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.297700:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe9862 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297707:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe9862 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297752:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297760:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297766:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297773:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297784:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.297789:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297797:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297812:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.297816:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.297821:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297827:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9854 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:1.0:1769074923.297848:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d00cf43 reply state 00000000048df9c8 transno 4294969013 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297859:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.297864:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185900) 00010000:00010000:1.0:1769074923.297867:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074923.297870:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074923.297906:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4be00/0x557988ac98fe984d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3be expref: 380 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.297923:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094c00/0x557988ac98fe9862 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3be expref: 379 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.297931:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16c:0x0].0x0 (ffff91604f185700) 00010000:00010000:1.0:1769074923.297933:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074923.297936:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094c00, rc 0) 00000100:00100000:1.0:1769074923.298020:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67370:x1855007616085504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1273us (1551us total) trans 4294969013 rc 0/0 00000100:00100000:1.0:1769074923.298030:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9373 00000100:00100000:2.0:1769074923.302001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.302139:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085632 00000100:00100000:1.0:1769074923.302152:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085632 00000100:00100000:1.0:1769074923.302236:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2699 00000100:00100000:1.0:1769074923.302251:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616085632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.302276:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.302303:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a3c5 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.302333:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.302526:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.302762:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.302775:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 157 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.302873:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 157 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.302890:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074923.303019:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2419:x1855007616085632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 771us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.303029:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2699 00000100:00100000:3.0:1769074923.307471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.307597:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085760 00000100:00100000:1.0:1769074923.307610:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085760 00000100:00100000:1.0:1769074923.307680:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2700 00000100:00100000:1.0:1769074923.307692:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:67370:x1855007616085760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.307715:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.307739:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a3cc expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.307778:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.307787:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.307789:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.307794:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3cc expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.307840:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.307869:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.307885:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626620544:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074923.308014:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074923.310881:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626620544:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074923.310932:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3cc expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.310962:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4be00, rc 0) 00000100:00100000:1.0:1769074923.311036:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:67370:x1855007616085760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3345us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.311046:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2700 00000100:00100000:2.0:1769074923.313647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.313874:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616085888 00000100:00100000:1.0:1769074923.313888:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616085888 00010000:00010000:1.0:1769074923.313961:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.314011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1878 00000100:00100000:1.0:1769074923.314022:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2420:x1855007616085888:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074923.314046:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074923.314071:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.314088:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.314119:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052a75a00/0x557988ac98fe9870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3c5 expref: 158 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.314138:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.314140:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.314149:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3cc expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.314166:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3cc expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.314223:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052b4be00/0x557988ac98fe9877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3cc expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074923.314242:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626620672:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074923.314362:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074923.320694:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626620672:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074923.320727:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074923.321471:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2420:x1855007616085888:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7443us (7831us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.321486:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1878 00000100:00100000:2.0:1769074923.321721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.321913:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086144 00000100:00100000:0.0:1769074923.321924:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086144 00000100:00100000:0.0:1769074923.321984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1863 00000100:00100000:0.0:1769074923.321993:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67370:x1855007616086144:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.323950:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67370:x1855007616086144:12345-192.168.204.32@tcp:35:cp.0 Request processed in 1942us (2214us total) trans 4294969014 rc 0/0 00000100:00100000:0.0:1769074923.323968:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1863 00000100:00100000:2.0:1769074923.351422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.354041:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086272 00000100:00100000:3.0:1769074923.354062:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086272 00000100:00100000:2.0:1769074923.354294:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 158 00000100:00100000:2.0:1769074923.354307:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2418:x1855007616086272:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074923.354394:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.354419:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe987e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a3d3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.354993:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074923.355013:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355026:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355044:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074923.355051:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355057:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355125:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355132:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355139:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355145:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.355150:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355158:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355172:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.355176:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.355193:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355200:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9885 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355218:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355223:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355230:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355235:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.355237:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355243:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355249:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f4df200) 00010000:00010000:2.0:1769074923.355251:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.355253:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355259:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe988c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.355293:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe987e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3d3 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.355304:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.355306:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074923.355309:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe987e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a3d3 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.355320:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc -2) 00000100:00100000:2.0:1769074923.355439:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2418:x1855007616086272:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1132us (4030us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074923.355449:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 158 00000100:00100000:3.0:1769074923.361847:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.362055:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086400 00000100:00100000:1.0:1769074923.362071:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086400 00000100:00100000:1.0:1769074923.362149:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9374 00000100:00100000:1.0:1769074923.362160:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67377:x1855007616086400:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074923.362217:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.362244:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9893 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a40b expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.362336:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.362366:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362379:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362399:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074923.362406:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362412:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362493:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362501:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362507:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362514:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362520:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.362525:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362559:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362575:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.362579:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.362585:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362591:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe989a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362614:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362621:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362627:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362632:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.362634:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362640:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362647:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff91604f185600) 00010000:00010000:1.0:1769074923.362649:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.362652:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362657:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe98a1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074923.362694:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9893 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a40b expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.362706:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.362709:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.362713:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9893 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a40b expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.362722:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074923.362820:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67377:x1855007616086400:12345-192.168.204.32@tcp:101:bash.0 Request processed in 660us (987us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.362828:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9374 00000100:00100000:1.0:1769074923.374078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.374130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.374247:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086656 00000100:00100000:2.0:1769074923.374261:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086656 00000100:00100000:2.0:1769074923.374349:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:2.0:1769074923.374361:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616086656:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074923.374412:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.374439:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe98a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a419 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.374573:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074923.374593:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374606:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374624:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074923.374631:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374637:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374707:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374715:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374720:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374728:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.374733:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374740:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374753:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.374757:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.374762:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374768:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe98af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374782:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374787:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374791:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374796:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.374798:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374804:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374811:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff91604f4df200) 00010000:00010000:2.0:1769074923.374814:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.374817:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374822:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe98b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074923.374856:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe98a8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a419 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.374866:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.374869:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074923.374872:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe98a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a419 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.374883:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc -2) 00000100:00100000:2.0:1769074923.374968:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616086656:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 608us (835us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074923.374976:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:3.0:1769074923.375744:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086528 00000100:00100000:3.0:1769074923.375755:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086528 00000100:00100000:3.0:1769074923.375802:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9375 00000100:00100000:3.0:1769074923.375810:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67378:x1855007616086528:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074923.375826:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.375844:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a412 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.375908:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.375921:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.375930:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.375945:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.375951:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.375957:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376005:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376013:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376020:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376026:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376032:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.376037:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376043:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376054:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.376057:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.376061:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376067:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376080:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376086:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376092:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376097:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.376100:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376105:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376112:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff916052af8400) 00010000:00010000:3.0:1769074923.376115:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.376117:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376122:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.376149:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a412 expref: 382 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.376159:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.376161:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.376164:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a412 expref: 382 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.376177:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074923.376245:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67378:x1855007616086528:12345-192.168.204.32@tcp:101:rm.0 Request processed in 436us (2181us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.376253:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9375 00000100:00100000:1.0:1769074923.381610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.381734:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086784 00000100:00100000:2.0:1769074923.381749:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086784 00000100:00100000:2.0:1769074923.381830:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9376 00000100:00100000:2.0:1769074923.381840:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67378:x1855007616086784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074923.381868:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.381894:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a420 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.381994:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.382013:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382029:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382046:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.382053:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382060:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382142:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382150:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382156:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382164:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382171:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.382176:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382197:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382214:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.382217:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.382224:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382230:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe98d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382249:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382256:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382261:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382265:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.382268:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382273:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382280:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff91604f4dff00) 00010000:00010000:2.0:1769074923.382282:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.382285:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382291:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe98e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.382328:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a420 expref: 382 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.382339:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.382342:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.382346:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a420 expref: 382 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.382357:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f000, rc 0) 00000100:00100000:2.0:1769074923.382441:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67378:x1855007616086784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 601us (922us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.382450:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9376 00000100:00100000:0.0:1769074923.400629:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.400724:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616086912 00000100:00100000:3.0:1769074923.400738:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616086912 00000100:00100000:3.0:1769074923.400819:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9377 00000100:00100000:3.0:1769074923.400830:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67379:x1855007616086912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.400857:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.400886:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a427 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.400975:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.400994:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401009:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401026:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.401033:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401039:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401113:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401120:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401126:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401131:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401138:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.401143:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401151:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401165:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.401170:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.401175:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401191:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe98ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401208:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401214:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401220:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401226:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.401229:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401235:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401243:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff916052af8400) 00010000:00010000:3.0:1769074923.401245:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.401248:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401254:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe98f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.401292:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a427 expref: 382 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.401304:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.401306:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.401310:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe98e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a427 expref: 382 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.401319:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074923.401395:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67379:x1855007616086912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 566us (782us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.401405:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9377 00000100:00100000:1.0:1769074923.405508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.405788:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087040 00000100:00100000:2.0:1769074923.405812:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087040 00000100:00100000:2.0:1769074923.405887:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9378 00000100:00100000:2.0:1769074923.405900:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67379:x1855007616087040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.405929:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.405957:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a42e expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.406045:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.406062:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406075:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406093:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.406100:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406106:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406191:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406200:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406206:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406213:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406219:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.406225:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406233:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406246:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.406250:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.406256:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406262:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9903 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406280:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406287:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406292:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406299:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.406301:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406308:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406315:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff91604f4dff00) 00010000:00010000:2.0:1769074923.406317:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.406320:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406326:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe990a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.406364:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a42e expref: 382 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.406376:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.406379:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.406383:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f000/0x557988ac98fe98fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a42e expref: 382 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.406393:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f000, rc 0) 00000100:00100000:2.0:1769074923.406473:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67379:x1855007616087040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 575us (991us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.406482:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9378 00000100:00100000:1.0:1769074923.410884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.410980:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087296 00000100:00100000:3.0:1769074923.410994:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087296 00000100:00100000:3.0:1769074923.411070:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9379 00000100:00100000:3.0:1769074923.411082:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67379:x1855007616087296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.411112:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.411140:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9911 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a435 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.411316:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.411334:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.411348:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.411365:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.411372:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.411378:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:3.0:1769074923.411822:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb2:0x0], index 1: 0 00010000:00010000:3.0:1769074923.412019:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9926 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.412032:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9926 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412041:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9926 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412090:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412098:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412103:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412110:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412116:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.412122:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412130:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412144:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.412147:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.412153:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412159:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9918 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:3.0:1769074923.412175:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000019fe59e reply state 0000000010fe1aaf transno 4294969015 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412199:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.412205:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff916052af8400) 00010000:00010000:3.0:1769074923.412208:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074923.412211:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074923.412248:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9911 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a435 expref: 384 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.412265:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b4b600/0x557988ac98fe9926 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a435 expref: 383 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.412273:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16d:0x0].0x0 (ffff916052a0c200) 00010000:00010000:3.0:1769074923.412277:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074923.412279:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b4b600, rc 0) 00000100:00100000:3.0:1769074923.412370:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67379:x1855007616087296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1289us (1503us total) trans 4294969015 rc 0/0 00000100:00100000:3.0:1769074923.412379:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9379 00000100:00100000:1.0:1769074923.412827:0:9989:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f183100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1855007626620800:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1769074923.412889:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074923.412969:0:9989:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074923.413057:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626620800 00000100:00100000:2.0:1769074923.413067:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626620800 00000100:00100000:2.0:1769074923.413137:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1769074923.413146:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:9989:x1855007626620800:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1769074923.413202:0:25313:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 194 00000100:00100000:2.0:1769074923.415144:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:9989:x1855007626620800:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1990us (2245us total) trans 4294967855 rc 0/0 00000100:00100000:2.0:1769074923.415162:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00080000:0.0:1769074923.415306:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074923.415421:0:9989:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f183100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1855007626620800:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1769074923.415441:0:9989:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xb2:0x0]-[0x2c0000400:0xe1:0x0] 00000100:00100000:3.0:1769074923.419662:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.419833:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087424 00000100:00100000:1.0:1769074923.419848:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087424 00000100:00100000:1.0:1769074923.419923:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2702 00000100:00100000:1.0:1769074923.419934:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+155:2419:x1855007616087424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.419957:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.419985:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a43c expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.420016:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.420042:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.420044:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.420055:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.420075:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 156 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.420090:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095a00, rc 0) 00000100:00100000:1.0:1769074923.420174:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616087424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 241us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.420213:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2702 00000100:00100000:0.0:1769074923.424842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.425155:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087552 00000100:00100000:2.0:1769074923.425170:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087552 00000100:00100000:2.0:1769074923.425251:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2703 00000100:00100000:2.0:1769074923.425263:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:67379:x1855007616087552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.425287:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.425311:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a443 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.425362:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 157 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074923.425372:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074923.425374:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074923.425379:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a443 expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.425427:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 157 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074923.425443:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 157 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:2.0:1769074923.425466:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604369df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626620928:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074923.425628:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160436cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1769074923.429423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.429576:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087680 00000100:00100000:1.0:1769074923.429590:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087680 00010000:00010000:1.0:1769074923.429667:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 158 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.429716:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1879 00000100:00100000:1.0:1769074923.429728:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2419:x1855007616087680:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074923.429749:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074923.429775:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 158 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.429802:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 158 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.429834:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.429838:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.429847:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a443 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.429858:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a443 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.429906:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a443 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074923.429923:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f180000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626621056:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074923.430031:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00010000:00010000:2.0:1769074923.432888:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e095a00/0x557988ac98fe9934 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a43c expref: 158 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:2.0:1769074923.432921:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604369df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626620928:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074923.432963:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e71f000/0x557988ac98fe993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a443 expref: 157 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.432981:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f000, rc 0) 00000100:00100000:2.0:1769074923.433060:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:67379:x1855007616087552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7799us (8236us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074923.433071:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2703 00000100:00100000:1.0:1769074923.434837:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f180000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626621056:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074923.434873:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074923.434951:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2419:x1855007616087680:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5223us (5542us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.434961:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1879 00000100:00100000:1.0:1769074923.441212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.441319:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616087936 00000100:00100000:0.0:1769074923.441335:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616087936 00000100:00100000:0.0:1769074923.441423:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1864 00000100:00100000:0.0:1769074923.441435:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67379:x1855007616087936:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.442162:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67379:x1855007616087936:12345-192.168.204.32@tcp:35:cp.0 Request processed in 724us (961us total) trans 4294969016 rc 0/0 00000100:00100000:0.0:1769074923.442174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1864 00000100:00100000:0.0:1769074923.473655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.473825:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088064 00000100:00100000:2.0:1769074923.473840:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088064 00000100:00100000:2.0:1769074923.473917:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9380 00000100:00100000:2.0:1769074923.473930:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67382:x1855007616088064:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074923.473960:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.473989:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9942 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a44a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.474085:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.474104:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474118:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474134:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074923.474141:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474147:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474237:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474245:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474252:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474259:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474265:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.474270:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474278:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474294:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.474297:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.474304:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474310:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9949 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474328:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474334:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474351:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474357:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.474360:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474365:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474373:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f4dff00) 00010000:00010000:2.0:1769074923.474375:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.474378:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474384:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9950 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074923.474421:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9942 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a44a expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.474432:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.474434:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.474438:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9942 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a44a expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.474448:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc 0) 00000100:00100000:2.0:1769074923.474526:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67382:x1855007616088064:12345-192.168.204.32@tcp:101:bash.0 Request processed in 599us (886us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.474590:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9380 00000100:00100000:1.0:1769074923.486047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.486152:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088192 00000100:00100000:3.0:1769074923.486167:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088192 00000100:00100000:3.0:1769074923.486260:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9381 00000100:00100000:3.0:1769074923.486273:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67383:x1855007616088192:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074923.486314:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.486352:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9957 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a451 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.486445:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.486464:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486477:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486497:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.486504:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486510:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486771:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486781:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486787:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486795:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486802:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.486806:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486815:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486830:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.486833:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.486839:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486845:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe995e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486863:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486870:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486875:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486880:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074923.486883:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486889:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486896:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f17d600) 00010000:00010000:3.0:1769074923.486899:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.486902:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486907:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9965 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.486947:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9957 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a451 expref: 386 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.486957:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074923.486960:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074923.486963:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb600/0x557988ac98fe9957 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a451 expref: 386 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.486977:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc 0) 00000100:00100000:3.0:1769074923.487105:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67383:x1855007616088192:12345-192.168.204.32@tcp:101:rm.0 Request processed in 834us (1072us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074923.487114:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9381 00000100:00100000:0.0:1769074923.490418:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.493970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.494203:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088448 00000100:00100000:0.0:1769074923.494217:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088448 00000100:00100000:0.0:1769074923.494298:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9382 00000100:00100000:0.0:1769074923.494311:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67383:x1855007616088448:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.494347:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.494376:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe996c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a45f expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.494471:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074923.494489:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494511:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494564:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074923.494573:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494580:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494658:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494666:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494673:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494679:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494686:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.494691:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494700:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494713:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.494717:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.494722:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494728:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe9973 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494744:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494749:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494754:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494759:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.494762:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494768:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494774:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f3c6400) 00010000:00010000:0.0:1769074923.494776:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.494779:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494783:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe997a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.494835:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe996c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a45f expref: 386 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.494846:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.494848:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.494851:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe996c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a45f expref: 386 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.494860:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074923.494934:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67383:x1855007616088448:12345-192.168.204.32@tcp:101:rm.0 Request processed in 624us (983us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.494943:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9382 00000100:00100000:2.0:1769074923.501307:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088320 00000100:00100000:2.0:1769074923.501334:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088320 00000100:00100000:2.0:1769074923.501431:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 160 00000100:00100000:2.0:1769074923.501443:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2420:x1855007616088320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074923.501509:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.501558:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9981 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a458 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.501647:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.501664:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501678:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501694:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.501701:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501706:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501781:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501799:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501806:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501812:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.501817:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501826:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501840:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.501843:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.501849:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501855:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9988 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501873:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501877:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501882:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501887:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.501890:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501895:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501900:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f4dff00) 00010000:00010000:2.0:1769074923.501902:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.501904:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501909:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe998f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.501940:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9981 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a458 expref: 386 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.501949:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.501951:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074923.501954:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9981 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a458 expref: 386 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.501962:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc -2) 00000100:00100000:2.0:1769074923.502059:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2420:x1855007616088320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 618us (11655us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074923.502068:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 160 00000100:00100000:3.0:1769074923.511932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.512774:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088576 00000100:00100000:1.0:1769074923.512864:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088576 00000100:00100000:1.0:1769074923.513001:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9383 00000100:00100000:1.0:1769074923.513013:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67384:x1855007616088576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.513044:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.513072:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9996 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a466 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.513170:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.513199:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513214:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513236:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.513245:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513251:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513335:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513354:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513361:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513367:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513374:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.513378:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513390:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513404:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.513407:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.513412:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513417:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe999d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513435:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513441:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513446:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513450:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.513453:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513458:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513464:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f185c00) 00010000:00010000:1.0:1769074923.513466:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.513469:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513474:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe99a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.513702:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9996 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a466 expref: 386 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.513715:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.513717:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.513721:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9996 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a466 expref: 386 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.513731:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094800, rc 0) 00000100:00100000:1.0:1769074923.513839:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67384:x1855007616088576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 828us (1925us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.513849:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9383 00000100:00100000:3.0:1769074923.517154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.518282:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088704 00000100:00100000:0.0:1769074923.518301:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088704 00000100:00100000:0.0:1769074923.518396:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9384 00000100:00100000:0.0:1769074923.518408:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67384:x1855007616088704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.518436:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.518469:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe99ab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a46d expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.518604:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074923.518622:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518638:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518655:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074923.518663:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518670:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518743:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518752:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518759:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518766:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.518775:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.518780:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519195:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519215:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.519219:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.519226:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519232:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fe99b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519253:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519258:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519263:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519268:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.519271:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519278:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519285:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f3c6400) 00010000:00010000:0.0:1769074923.519287:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.519291:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519296:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fe99b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074923.519345:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe99ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a46d expref: 386 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.519356:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.519359:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.519362:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fe99ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a46d expref: 386 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.519372:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074923.519470:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67384:x1855007616088704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1064us (2330us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.519479:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9384 00000100:00100000:3.0:1769074923.522665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.522780:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616088960 00000100:00100000:0.0:1769074923.522803:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616088960 00000100:00100000:0.0:1769074923.522880:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9385 00000100:00100000:0.0:1769074923.522891:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67384:x1855007616088960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.522919:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.522947:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe99c0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a474 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.523142:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074923.523162:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.523175:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.523204:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074923.523212:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.523219:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074923.523723:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb2:0x0], index 0: 0 00010000:00010000:0.0:1769074923.523933:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa400/0x557988ac98fe99d5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074923.523944:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa400/0x557988ac98fe99d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.523952:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa400/0x557988ac98fe99d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.523999:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524006:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524014:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524021:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.524025:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524034:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524049:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.524052:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.524057:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524062:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99c7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074923.524077:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fb022f7e reply state 00000000571ff81e transno 4294969017 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524089:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074923.524095:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f15f100) 00010000:00010000:0.0:1769074923.524098:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074923.524101:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074923.524142:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fe99c0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a474 expref: 388 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.524159:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa400/0x557988ac98fe99d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a474 expref: 387 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.524167:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16e:0x0].0x0 (ffff91604e0d3700) 00010000:00010000:0.0:1769074923.524169:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074923.524171:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa400, rc 0) 00000100:00100000:0.0:1769074923.524284:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67384:x1855007616088960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1393us (1635us total) trans 4294969017 rc 0/0 00000100:00100000:0.0:1769074923.524297:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9385 00000100:00100000:0.0:1769074923.524392:0:8615:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8615:1855007626621184:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1769074923.524453:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074923.524560:0:8615:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece000 going to sleep for 11 seconds 00000100:00100000:3.0:1769074923.528051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.528292:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626621184 00000100:00100000:0.0:1769074923.528308:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626621184 00000100:00100000:0.0:1769074923.528404:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089088 00000100:00100000:0.0:1769074923.528408:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089088 00000100:00100000:0.0:1769074923.528440:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1769074923.528451:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:8615:x1855007626621184:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1769074923.528525:0:24564:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 194 00000100:00080000:3.0:1769074923.529019:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074923.529615:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2705 00000100:00100000:3.0:1769074923.529630:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2419:x1855007616089088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.529648:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.529677:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a47b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074923.529704:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074923.529729:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.529731:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.529743:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 158 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.529764:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 158 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.529779:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074923.529877:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2419:x1855007616089088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 252us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074923.529887:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2705 00000100:00100000:3.0:1769074923.532589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.532636:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089216 00000100:00100000:3.0:1769074923.532650:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089216 00000100:00100000:3.0:1769074923.532730:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2706 00000100:00100000:3.0:1769074923.532743:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:67384:x1855007616089216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.532766:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.532911:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a482 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.532958:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.532967:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.532970:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074923.532975:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a482 expref: 159 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.533023:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074923.533041:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:3.0:1769074923.533060:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626621312:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074923.533208:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbda80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074923.536365:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626621312:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074923.536422:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a482 expref: 159 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.536449:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb600, rc 0) 00000100:00100000:3.0:1769074923.536560:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:67384:x1855007616089216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3792us (3958us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074923.536572:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2706 00000100:00100000:3.0:1769074923.539800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.540583:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089344 00000100:00100000:1.0:1769074923.540598:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089344 00010000:00010000:1.0:1769074923.540676:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.540717:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1880 00000100:00100000:1.0:1769074923.540728:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2420:x1855007616089344:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074923.540749:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074923.540774:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.540804:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.540843:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe99e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a47b expref: 159 pid: 25313 timeout: 2012 lvb_type: 1 00010000:00010000:1.0:1769074923.540864:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.540867:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.540875:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a482 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.540886:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a482 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.540939:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052adb600/0x557988ac98fe99ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a482 expref: 158 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074923.540956:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626621440:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074923.541067:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074923.546200:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:8615:x1855007626621184:12345-0@lo:5:osp-pre-0-1.0 Request processed in 17724us (21719us total) trans 4294967844 rc 0/0 00000100:00100000:0.0:1769074923.546221:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1769074923.546311:0:8615:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8615:1855007626621184:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1769074923.546332:0:8615:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xb2:0x0]-[0x280000400:0xe1:0x0] 00000100:00100000:2.0:1769074923.547208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.547288:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626621440:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074923.547318:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074923.547403:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2420:x1855007616089344:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6676us (7626us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.547414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1880 00000100:00100000:0.0:1769074923.547453:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089600 00000100:00100000:0.0:1769074923.547461:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089600 00000100:00100000:0.0:1769074923.547514:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1865 00000100:00100000:0.0:1769074923.547523:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67384:x1855007616089600:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.547913:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67384:x1855007616089600:12345-192.168.204.32@tcp:35:cp.0 Request processed in 390us (711us total) trans 4294969018 rc 0/0 00000100:00100000:0.0:1769074923.547921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1865 00000100:00100000:2.0:1769074923.577642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.577793:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089728 00000100:00100000:0.0:1769074923.577809:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089728 00000100:00100000:0.0:1769074923.577892:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9386 00000100:00100000:0.0:1769074923.577905:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67387:x1855007616089728:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074923.577932:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.577960:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a489 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.578048:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.578066:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578081:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578097:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.578104:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578111:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578191:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578204:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578211:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578217:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.578222:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578231:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578246:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.578249:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.578255:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578260:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe99f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578276:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578282:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578287:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578292:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.578295:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578305:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578312:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.578314:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.578317:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578322:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe99ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.578371:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99f1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a489 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.578382:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.578384:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.578388:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe99f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a489 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.578397:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa200, rc 0) 00000100:00100000:0.0:1769074923.578480:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67387:x1855007616089728:12345-192.168.204.32@tcp:101:bash.0 Request processed in 578us (852us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.578489:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9386 00000100:00100000:3.0:1769074923.589030:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.589162:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089856 00000100:00100000:1.0:1769074923.589187:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089856 00000100:00100000:1.0:1769074923.589268:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9387 00000100:00100000:1.0:1769074923.589279:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67388:x1855007616089856:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074923.589314:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.589354:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9a06 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a490 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.589443:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.589465:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589477:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589494:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.589501:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589507:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589642:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589651:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589658:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589665:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589672:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.589678:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589687:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589706:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.589710:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.589716:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589722:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9a0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589744:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589750:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589756:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589761:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.589764:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589769:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589777:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604f185c00) 00010000:00010000:1.0:1769074923.589779:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.589782:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589788:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9a14 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.589823:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9a06 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a490 expref: 390 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.589835:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.589838:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.589842:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9a06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a490 expref: 390 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.589852:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094800, rc 0) 00000100:00100000:1.0:1769074923.589933:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67388:x1855007616089856:12345-192.168.204.32@tcp:101:rm.0 Request processed in 655us (919us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.589942:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9387 00000100:00100000:2.0:1769074923.594807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.594901:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616089984 00000100:00100000:1.0:1769074923.594915:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616089984 00000100:00100000:1.0:1769074923.594994:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 161 00000100:00100000:1.0:1769074923.595006:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2418:x1855007616089984:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074923.595058:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.595088:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a497 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.595169:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.595197:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595212:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595230:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.595241:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595248:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595326:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595347:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595355:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595362:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.595367:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595376:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595390:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.595394:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.595400:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595407:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595425:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595431:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595437:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595442:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.595445:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595451:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595458:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f185200) 00010000:00010000:1.0:1769074923.595461:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.595463:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595468:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a29 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.595504:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a1b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a497 expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.595515:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.595518:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074923.595521:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a497 expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.595570:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc -2) 00000100:00100000:1.0:1769074923.595656:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2418:x1855007616089984:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 652us (874us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074923.595666:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 161 00000100:00100000:2.0:1769074923.599048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.599151:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090112 00000100:00100000:0.0:1769074923.599165:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090112 00000100:00100000:0.0:1769074923.599256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9388 00000100:00100000:0.0:1769074923.599268:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67388:x1855007616090112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.599297:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.599327:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a30 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a49e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.599428:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.599446:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599459:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599476:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.599483:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599489:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599612:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599620:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599626:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599632:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.599637:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599645:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599661:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.599665:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.599671:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599677:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a37 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599692:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599698:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599703:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599709:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.599711:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599718:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599725:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.599727:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.599730:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599736:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a3e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.599772:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a30 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a49e expref: 390 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.599783:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.599785:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.599788:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a30 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a49e expref: 390 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.599796:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa200, rc 0) 00000100:00100000:0.0:1769074923.599867:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67388:x1855007616090112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 600us (833us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.599875:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9388 00000100:00100000:3.0:1769074923.614361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.614482:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090240 00000100:00100000:1.0:1769074923.614506:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090240 00000100:00100000:1.0:1769074923.614608:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9389 00000100:00100000:1.0:1769074923.614619:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67389:x1855007616090240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.614645:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.614672:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a45 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4a5 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.614760:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.614777:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614789:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614806:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.614813:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614819:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614887:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614894:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614900:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614910:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614916:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.614921:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614928:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614941:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.614945:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.614950:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614956:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9a4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614975:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614981:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614987:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614991:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.614993:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.614998:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.615007:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604f185200) 00010000:00010000:1.0:1769074923.615010:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.615012:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.615017:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a53 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.615049:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a45 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4a5 expref: 390 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.615059:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.615060:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.615063:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a45 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4a5 expref: 390 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.615072:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc 0) 00000100:00100000:1.0:1769074923.615153:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67389:x1855007616090240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 536us (817us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.615162:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9389 00000100:00100000:2.0:1769074923.618815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.618930:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090368 00000100:00100000:0.0:1769074923.618946:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090368 00000100:00100000:0.0:1769074923.619025:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9390 00000100:00100000:0.0:1769074923.619037:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67389:x1855007616090368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.619063:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.619093:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a5a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.619191:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.619209:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619221:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619237:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.619248:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619254:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619319:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619326:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619333:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619351:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.619356:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619365:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619379:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.619382:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.619387:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619394:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9a61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619410:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619416:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619422:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619426:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.619428:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619433:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619439:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.619441:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.619443:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619448:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9a68 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.619484:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a5a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ac expref: 390 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.619511:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.619514:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.619518:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9a5a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ac expref: 390 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.619559:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa200, rc 0) 00000100:00100000:0.0:1769074923.619649:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67389:x1855007616090368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 613us (1176us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.619658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9390 00000100:00100000:2.0:1769074923.623718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.623922:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090624 00000100:00100000:3.0:1769074923.623936:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090624 00000100:00100000:3.0:1769074923.624013:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9391 00000100:00100000:3.0:1769074923.624025:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67389:x1855007616090624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074923.624054:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074923.624082:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe9a6f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4b3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074923.624261:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.624279:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.624292:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.624318:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074923.624326:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074923.624332:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074923.625163:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb3:0x0], index 1: 0 00010000:00010000:2.0:1769074923.625386:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9a84 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.625399:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625408:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625448:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625456:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625462:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625469:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625476:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.625481:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625489:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625736:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.625740:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.625747:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625758:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9a76 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074923.625778:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000409a4942 reply state 00000000a600a86e transno 4294969019 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.625999:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.626006:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604f8b3000) 00010000:00010000:2.0:1769074923.626008:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074923.626012:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074923.626062:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fe9a6f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4b3 expref: 392 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.626079:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fa00/0x557988ac98fe9a84 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4b3 expref: 391 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.626087:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x16f:0x0].0x0 (ffff91604f4dff00) 00010000:00010000:2.0:1769074923.626089:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074923.626092:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fa00, rc 0) 00000100:00100000:2.0:1769074923.626196:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67389:x1855007616090624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2173us (2494us total) trans 4294969019 rc 0/0 00000100:00100000:2.0:1769074923.626205:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9391 00000100:00100000:2.0:1769074923.629758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.629841:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090752 00000100:00100000:1.0:1769074923.629855:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090752 00000100:00100000:1.0:1769074923.629932:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2707 00000100:00100000:1.0:1769074923.629944:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+156:2420:x1855007616090752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.629968:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.629997:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4ba expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.630032:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.630059:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.630061:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.630073:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 157 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.630092:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 157 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.630107:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:1.0:1769074923.630189:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2420:x1855007616090752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 247us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.630196:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2707 00000100:00100000:2.0:1769074923.640927:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.641039:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616090880 00000100:00100000:1.0:1769074923.641052:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616090880 00000100:00100000:1.0:1769074923.641122:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2708 00000100:00100000:1.0:1769074923.641132:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:67389:x1855007616090880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.641157:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.641192:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4c1 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.641232:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 158 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.641242:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.641244:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.641249:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c1 expref: 158 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.641290:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 158 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.641305:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 158 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.641321:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626621568:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074923.641453:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074923.644581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.644746:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091008 00000100:00100000:0.0:1769074923.644760:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091008 00010000:00010000:0.0:1769074923.644848:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 159 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:0.0:1769074923.644902:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1881 00000100:00100000:0.0:1769074923.644914:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2420:x1855007616091008:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074923.644932:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074923.644959:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 159 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074923.644974:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 159 pid: 24564 timeout: 2012 lvb_type: 1 00010000:00010000:0.0:1769074923.645008:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.645011:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.645021:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c1 expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.645033:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c1 expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.645084:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c1 expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074923.645101:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626621696:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074923.645227:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece000 going to sleep for 11 seconds 00010000:00010000:1.0:1769074923.645936:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a75a00/0x557988ac98fe9a92 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4ba expref: 159 pid: 24564 timeout: 2012 lvb_type: 1 00000100:00100000:1.0:1769074923.645956:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626621568:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074923.645989:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e296e00/0x557988ac98fe9a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c1 expref: 158 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.646001:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296e00, rc 0) 00000100:00100000:1.0:1769074923.646055:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:67389:x1855007616090880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4924us (5142us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.646064:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2708 00000100:00100000:3.0:1769074923.652241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.652351:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091264 00000100:00100000:1.0:1769074923.652365:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091264 00000100:00100000:1.0:1769074923.652443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1866 00000100:00100000:1.0:1769074923.652454:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67389:x1855007616091264:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074923.652907:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67389:x1855007616091264:12345-192.168.204.32@tcp:35:cp.0 Request processed in 452us (681us total) trans 4294969020 rc 0/0 00000100:00100000:1.0:1769074923.652916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1866 00000100:00100000:0.0:1769074923.653662:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626621696:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074923.653699:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074923.653746:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2420:x1855007616091008:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8834us (9228us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.653756:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1881 00000100:00100000:2.0:1769074923.695614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.695722:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091392 00000100:00100000:1.0:1769074923.695737:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091392 00000100:00100000:1.0:1769074923.695815:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9392 00000100:00100000:1.0:1769074923.695826:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67393:x1855007616091392:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074923.695852:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.695877:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9aa0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4c8 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.695961:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.695978:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.695992:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696010:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.696017:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696022:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696089:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696100:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696106:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696112:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696118:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.696123:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696131:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696143:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.696146:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.696152:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696158:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9aa7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696184:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696191:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696197:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696202:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.696205:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696211:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696218:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f185800) 00010000:00010000:1.0:1769074923.696220:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.696222:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696228:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.696265:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9aa0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c8 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.696277:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.696279:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.696283:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9aa0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4c8 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.696292:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074923.696368:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67393:x1855007616091392:12345-192.168.204.32@tcp:101:bash.0 Request processed in 544us (769us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.696376:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9392 00010000:00010000:0.0:1769074923.699823:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074923.707239:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.707381:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091520 00000100:00100000:0.0:1769074923.707395:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091520 00000100:00100000:0.0:1769074923.707481:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9393 00000100:00100000:0.0:1769074923.707503:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67394:x1855007616091520:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.707583:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.707613:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ab5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4cf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.707715:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.707733:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707747:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707763:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.707770:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707777:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707855:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707864:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707870:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707877:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.707881:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707890:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707904:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.707908:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.707913:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707920:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9abc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707936:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707942:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707948:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707953:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.707957:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707964:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707971:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.707974:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.707976:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.707981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9ac3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.708021:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ab5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4cf expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.708033:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.708035:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.708039:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ab5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4cf expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.708049:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074923.708138:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67394:x1855007616091520:12345-192.168.204.32@tcp:101:rm.0 Request processed in 647us (913us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.708146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9393 00000100:00100000:3.0:1769074923.712521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.712598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.712740:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091776 00000100:00100000:1.0:1769074923.712757:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091776 00000100:00100000:1.0:1769074923.712839:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9394 00000100:00100000:1.0:1769074923.712849:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67394:x1855007616091776:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074923.712879:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.712904:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4dd expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.712993:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.713010:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713022:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713037:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.713043:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713048:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713117:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713124:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713129:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713136:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713142:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.713147:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713155:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713168:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.713171:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.713186:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713193:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095a00/0x557988ac98fe9ad1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713209:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713214:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713219:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713223:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.713226:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713231:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713236:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f185800) 00010000:00010000:1.0:1769074923.713239:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.713241:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713250:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9ad8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.713285:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aca lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4dd expref: 394 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.713296:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.713298:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.713302:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9aca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4dd expref: 394 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.713311:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094800, rc 0) 00000100:00100000:1.0:1769074923.713401:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67394:x1855007616091776:12345-192.168.204.32@tcp:101:rm.0 Request processed in 553us (801us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.713410:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9394 00000100:00100000:2.0:1769074923.713757:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091648 00000100:00100000:2.0:1769074923.713765:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091648 00000100:00100000:2.0:1769074923.713810:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 162 00000100:00100000:2.0:1769074923.713818:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:2417:x1855007616091648:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074923.713851:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.713866:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9adf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4d6 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.713907:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.713919:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.713929:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.713943:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.713950:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.713956:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.713996:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714002:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714008:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714012:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.714016:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714022:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714031:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.714034:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.714037:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714042:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9ae6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714055:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714059:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714064:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714068:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.714071:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714076:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714083:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604f4df200) 00010000:00010000:2.0:1769074923.714085:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.714087:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714098:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9aed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.714119:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9adf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4d6 expref: 394 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.714127:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.714129:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074923.714132:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9adf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4d6 expref: 394 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.714141:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc -2) 00000100:00100000:2.0:1769074923.714209:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:2417:x1855007616091648:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 391us (1704us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074923.714217:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 162 00000100:00100000:3.0:1769074923.732516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.732830:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616091904 00000100:00100000:0.0:1769074923.732846:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616091904 00000100:00100000:0.0:1769074923.732927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9395 00000100:00100000:0.0:1769074923.732940:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67395:x1855007616091904:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.732973:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.733003:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9af4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.733102:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.733121:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733136:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733153:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.733160:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733166:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733248:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733256:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733263:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733270:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.733275:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733288:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733303:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.733307:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.733314:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733320:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9afb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733336:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733342:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733348:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733354:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.733357:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733363:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733370:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.733372:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.733375:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733381:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b02 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.733420:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9af4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4e4 expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.733430:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.733433:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.733436:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9af4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4e4 expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.733445:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074923.733741:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67395:x1855007616091904:12345-192.168.204.32@tcp:101:cp.0 Request processed in 802us (1250us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.733751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9395 00000100:00100000:3.0:1769074923.737479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.738417:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092032 00000100:00100000:0.0:1769074923.738436:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092032 00000100:00100000:0.0:1769074923.738611:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9396 00000100:00100000:0.0:1769074923.738622:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67395:x1855007616092032:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.738654:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.738682:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9b09 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.738775:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.738992:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739008:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739030:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.739037:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739043:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739110:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739118:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739125:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739131:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.739135:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739144:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739158:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.739162:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.739167:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739181:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739197:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739205:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739210:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739215:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.739219:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739224:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739232:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604e0d3d00) 00010000:00010000:0.0:1769074923.739235:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.739239:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739245:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b17 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.739295:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9b09 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4eb expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.739308:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.739311:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.739315:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9b09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4eb expref: 394 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.739325:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb400, rc 0) 00000100:00100000:0.0:1769074923.739443:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67395:x1855007616092032:12345-192.168.204.32@tcp:101:cp.0 Request processed in 822us (1980us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.739454:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9396 00000100:00100000:1.0:1769074923.743739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.743925:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092288 00000100:00100000:2.0:1769074923.743938:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092288 00000100:00100000:2.0:1769074923.744016:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9397 00000100:00100000:2.0:1769074923.744029:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67395:x1855007616092288:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.744058:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.744087:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b1e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4f2 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.744265:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.744284:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.744301:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.744315:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.744322:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.744328:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074923.745062:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb3:0x0], index 0: 0 00010000:00010000:2.0:1769074923.745275:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9b33 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.745290:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745299:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745775:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745867:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745874:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745882:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745894:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.745899:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745908:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745924:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.745927:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.745933:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745940:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b25 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074923.745956:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075dc2e69 reply state 00000000e052543e transno 4294969021 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745968:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.745974:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f4df200) 00010000:00010000:2.0:1769074923.745976:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074923.745980:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074923.746025:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b1e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f2 expref: 396 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.746041:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f600/0x557988ac98fe9b33 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f2 expref: 395 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.746048:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x170:0x0].0x0 (ffff91604f4f6400) 00010000:00010000:2.0:1769074923.746051:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074923.746053:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f600, rc 0) 00000100:00100000:2.0:1769074923.746192:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67395:x1855007616092288:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2164us (2470us total) trans 4294969021 rc 0/0 00000100:00100000:2.0:1769074923.746202:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9397 00000100:00100000:2.0:1769074923.750779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.751125:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092416 00000100:00100000:1.0:1769074923.751141:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092416 00000100:00100000:1.0:1769074923.751252:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2709 00000100:00100000:1.0:1769074923.751266:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2419:x1855007616092416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.751293:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.751323:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a4f9 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.751367:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.751392:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.751394:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.751405:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 159 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.751425:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 159 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.751442:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074923.751524:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2419:x1855007616092416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 262us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.751555:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2709 00000100:00100000:0.0:1769074923.755198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.755302:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092544 00000100:00100000:1.0:1769074923.755315:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092544 00000100:00100000:1.0:1769074923.755403:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2710 00000100:00100000:1.0:1769074923.755414:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:67395:x1855007616092544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.755438:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.755462:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a500 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.755501:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 160 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.755511:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.755514:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.755518:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a500 expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.755696:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 160 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.755718:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074923.755736:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626621824:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074923.756020:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074923.760651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.760740:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092672 00000100:00100000:0.0:1769074923.760754:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092672 00010000:00010000:0.0:1769074923.760839:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 161 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074923.760891:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1882 00000100:00100000:0.0:1769074923.760903:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2419:x1855007616092672:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074923.760922:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074923.760950:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 161 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074923.760966:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 161 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074923.760999:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.761001:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.761011:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a500 expref: 161 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.761023:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a500 expref: 161 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.761071:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a500 expref: 161 pid: 8625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074923.761094:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626621952:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074923.761218:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074923.764413:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626621952:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074923.764455:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074923.764561:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2419:x1855007616092672:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3631us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.764576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1882 00010000:00010000:1.0:1769074923.765351:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e094a00/0x557988ac98fe9b41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a4f9 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074923.765380:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1855007626621824:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074923.765410:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095a00/0x557988ac98fe9b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a500 expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.765428:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095a00, rc 0) 00000100:00100000:1.0:1769074923.765487:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:67395:x1855007616092544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10073us (10316us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.765504:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2710 00000100:00100000:2.0:1769074923.771363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.771477:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616092928 00000100:00100000:0.0:1769074923.771501:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616092928 00000100:00100000:0.0:1769074923.771617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1867 00000100:00100000:0.0:1769074923.771629:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67395:x1855007616092928:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.772281:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67395:x1855007616092928:12345-192.168.204.32@tcp:35:cp.0 Request processed in 649us (931us total) trans 4294969022 rc 0/0 00000100:00100000:0.0:1769074923.772292:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1867 00000100:00100000:0.0:1769074923.806063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.806247:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093056 00000100:00100000:2.0:1769074923.806263:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093056 00000100:00100000:2.0:1769074923.806435:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9398 00000100:00100000:2.0:1769074923.806448:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67398:x1855007616093056:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074923.806479:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.806519:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a507 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.806856:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.806876:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.806889:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.806907:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.806915:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.806925:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807003:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807011:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807017:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807024:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807030:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.807035:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807042:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807055:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.807059:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.807064:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807071:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9b56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807088:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807094:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807100:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807104:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.807107:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807113:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807120:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074923.807123:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.807125:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807131:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9b5d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.807165:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b4f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a507 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.807185:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.807188:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.807192:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9b4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a507 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.807202:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc 0) 00000100:00100000:2.0:1769074923.807299:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67398:x1855007616093056:12345-192.168.204.32@tcp:101:bash.0 Request processed in 852us (1252us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.807308:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9398 00000100:00100000:2.0:1769074923.818687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.818736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.819051:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093312 00000100:00100000:1.0:1769074923.819066:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093312 00000100:00100000:1.0:1769074923.819148:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:1.0:1769074923.819160:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:2417:x1855007616093312:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074923.819231:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.819263:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9b64 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a515 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.819368:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.819387:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819402:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819447:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074923.819455:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819462:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819577:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819585:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819592:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819610:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.819615:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819623:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819644:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.819647:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.819653:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819659:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fe9b6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819678:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819684:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819690:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819696:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.819698:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819704:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819711:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff916052708d00) 00010000:00010000:1.0:1769074923.819713:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.819716:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819722:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fe9b72 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074923.819758:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9b64 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a515 expref: 398 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.819769:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.819771:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074923.819775:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98fe9b64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a515 expref: 398 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.819983:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc -2) 00000100:00100000:1.0:1769074923.820086:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:2417:x1855007616093312:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 926us (1348us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074923.820095:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:0.0:1769074923.822368:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093184 00000100:00100000:0.0:1769074923.822390:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093184 00000100:00100000:0.0:1769074923.822488:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9399 00000100:00100000:0.0:1769074923.822739:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67399:x1855007616093184:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.822766:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.822803:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b79 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a50e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.822890:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.822909:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.822923:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.822938:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.822945:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.822950:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823017:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823024:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823032:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823038:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.823044:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823052:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823067:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.823070:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.823077:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823083:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9b80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823098:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823104:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823110:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823115:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.823119:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823124:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823131:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604e0d3d00) 00010000:00010000:0.0:1769074923.823134:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.823137:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823142:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9b87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.823186:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b79 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a50e expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.823198:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.823201:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.823205:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9b79 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a50e expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.823216:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074923.823296:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67399:x1855007616093184:12345-192.168.204.32@tcp:101:rm.0 Request processed in 562us (4626us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.827289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9399 00000100:00100000:2.0:1769074923.828409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.828510:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093440 00000100:00100000:0.0:1769074923.828525:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093440 00000100:00100000:0.0:1769074923.828613:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9400 00000100:00100000:0.0:1769074923.828625:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67399:x1855007616093440:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.828654:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.828685:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9b8e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a51c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.828774:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.828805:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828820:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828838:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.828844:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828850:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828917:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828925:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828931:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828938:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.828943:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828951:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828965:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.828968:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.828975:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9b95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.828998:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829005:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829011:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829015:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.829020:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829025:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829031:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.829034:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.829036:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829042:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9b9c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.829082:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9b8e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a51c expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.829092:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.829094:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.829098:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9b8e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a51c expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.829106:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074923.829195:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67399:x1855007616093440:12345-192.168.204.32@tcp:101:rm.0 Request processed in 572us (794us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.829204:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9400 00000100:00100000:3.0:1769074923.845697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.845833:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093568 00000100:00100000:2.0:1769074923.845850:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093568 00000100:00100000:2.0:1769074923.845924:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9401 00000100:00100000:2.0:1769074923.845934:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67400:x1855007616093568:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074923.845968:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.846001:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9ba3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a523 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.846096:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.846114:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846129:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846146:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074923.846153:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846159:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846247:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846255:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846263:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846270:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846276:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.846280:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846288:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846304:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.846307:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.846313:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846319:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9baa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846336:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846342:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846348:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846353:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.846356:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846366:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846373:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074923.846376:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.846378:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846384:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9bb1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074923.846422:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9ba3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a523 expref: 398 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.846432:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.846435:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.846438:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9ba3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a523 expref: 398 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.846446:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc 0) 00000100:00100000:2.0:1769074923.846652:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67400:x1855007616093568:12345-192.168.204.32@tcp:101:cp.0 Request processed in 718us (969us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074923.846661:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9401 00000100:00100000:1.0:1769074923.858289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.859137:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093696 00000100:00100000:0.0:1769074923.859155:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093696 00000100:00100000:0.0:1769074923.859357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9402 00000100:00100000:0.0:1769074923.859371:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67400:x1855007616093696:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.859405:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.859434:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9bb8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a52a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.859722:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.859742:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859759:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859775:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.859860:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859869:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859941:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859951:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859958:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859966:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.859970:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.859984:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860000:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.860003:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.860010:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860017:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfba00/0x557988ac98fe9bbf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860033:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860040:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860046:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860052:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.860055:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860061:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860068:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.860071:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.860074:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860079:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9bc6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.860121:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9bb8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a52a expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.860132:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.860135:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.860140:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9bb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a52a expref: 398 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.860149:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074923.860318:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67400:x1855007616093696:12345-192.168.204.32@tcp:101:cp.0 Request processed in 949us (2043us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.860328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9402 00000100:00100000:2.0:1769074923.864162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.864361:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616093952 00000100:00100000:0.0:1769074923.864377:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616093952 00000100:00100000:0.0:1769074923.864445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9403 00000100:00100000:0.0:1769074923.864457:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67400:x1855007616093952:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.864486:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.864513:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9bcd lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a531 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.864693:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.864712:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.864726:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.864748:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x4f389932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.864756:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.864763:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:0.0:1769074923.865780:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb4:0x0], index 1: 0 00010000:00010000:0.0:1769074923.866098:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb800/0x557988ac98fe9be2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x171:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.866114:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb800/0x557988ac98fe9be2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866126:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb800/0x557988ac98fe9be2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866182:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866190:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866198:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866204:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.866209:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866217:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866232:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.866236:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.866242:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866248:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9bd4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:0.0:1769074923.866264:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003971d65c reply state 00000000c14cd131 transno 4294969023 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866277:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.866283:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604e0d3d00) 00010000:00010000:0.0:1769074923.866286:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074923.866289:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074923.867753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9bcd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a531 expref: 400 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.867871:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb800/0x557988ac98fe9be2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a531 expref: 399 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.867882:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x171:0x0].0x0 (ffff91604e0d3b00) 00010000:00010000:0.0:1769074923.867885:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074923.867889:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb800, rc 0) 00000100:00100000:0.0:1769074923.868061:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67400:x1855007616093952:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3604us (3914us total) trans 4294969023 rc 0/0 00000100:00100000:0.0:1769074923.868072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9403 00000100:00100000:2.0:1769074923.872022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.872128:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094080 00000100:00100000:1.0:1769074923.872142:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094080 00000100:00100000:1.0:1769074923.872258:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2711 00000100:00100000:1.0:1769074923.872270:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+157:2420:x1855007616094080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.872295:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.872324:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a538 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.872365:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.872391:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.872394:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.872404:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 158 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.872423:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 158 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.872446:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44a00, rc 0) 00000100:00100000:1.0:1769074923.872522:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2420:x1855007616094080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 253us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.872550:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2711 00000100:00100000:2.0:1769074923.876272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.876367:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094208 00000100:00100000:1.0:1769074923.876381:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094208 00000100:00100000:1.0:1769074923.876457:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2712 00000100:00100000:1.0:1769074923.876468:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:67400:x1855007616094208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.876493:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.876518:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a53f expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.876592:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 159 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.876602:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.876604:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.876608:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a53f expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.876656:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 159 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.876673:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 159 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074923.876697:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626622080:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074923.876828:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074923.881671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.881765:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094336 00000100:00100000:0.0:1769074923.881779:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094336 00010000:00010000:0.0:1769074923.881865:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074923.881919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1883 00000100:00100000:0.0:1769074923.881931:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2419:x1855007616094336:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074923.881954:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074923.881981:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074923.881999:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074923.882037:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.882040:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.882051:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a53f expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.882062:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a53f expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.882111:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a53f expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074923.882126:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626622208:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074923.882246:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044ff2d80 going to sleep for 11 seconds 00010000:00010000:1.0:1769074923.883304:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a44a00/0x557988ac98fe9bf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a538 expref: 160 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074923.883353:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626622080:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074923.883393:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a44600/0x557988ac98fe9bf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a53f expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.883407:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44600, rc 0) 00000100:00100000:1.0:1769074923.883481:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:67400:x1855007616094208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7014us (7238us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.883491:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2712 00000100:00100000:0.0:1769074923.887027:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626622208:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074923.887067:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074923.887144:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2419:x1855007616094336:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5214us (5490us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.887157:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1883 00000100:00100000:2.0:1769074923.889803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.889958:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094592 00000100:00100000:0.0:1769074923.889974:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094592 00000100:00100000:0.0:1769074923.890049:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1868 00000100:00100000:0.0:1769074923.890062:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67400:x1855007616094592:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.890512:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67400:x1855007616094592:12345-192.168.204.32@tcp:35:cp.0 Request processed in 450us (729us total) trans 4294969024 rc 0/0 00000100:00100000:0.0:1769074923.890521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1868 00000100:00100000:2.0:1769074923.920808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.920932:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094720 00000100:00100000:0.0:1769074923.920947:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094720 00000100:00100000:0.0:1769074923.921033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9404 00000100:00100000:0.0:1769074923.921046:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67403:x1855007616094720:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074923.921076:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.921106:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9bfe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a546 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.921207:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.921226:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921239:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921258:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.921266:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921273:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921354:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921362:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921368:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921375:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.921380:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921389:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921403:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.921406:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.921412:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921418:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921434:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921439:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921445:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921449:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.921451:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921456:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921462:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.921464:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.921466:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921472:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c0c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.921523:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9bfe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a546 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.921598:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.921601:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.921605:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9bfe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a546 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.921616:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074923.921703:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67403:x1855007616094720:12345-192.168.204.32@tcp:101:bash.0 Request processed in 659us (926us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.921711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9404 00000100:00100000:2.0:1769074923.932957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.933061:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094848 00000100:00100000:1.0:1769074923.933077:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094848 00000100:00100000:1.0:1769074923.933156:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9405 00000100:00100000:1.0:1769074923.933176:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67404:x1855007616094848:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074923.933208:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.933236:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a54d expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.933321:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.933350:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933365:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933382:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.933388:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933394:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933469:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933475:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933481:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933488:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933495:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.933500:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933509:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933524:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.933527:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.933574:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933580:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933598:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933604:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933610:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933614:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.933616:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933622:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933628:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff916052708c00) 00010000:00010000:1.0:1769074923.933631:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.933633:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933639:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c21 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.933687:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c13 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a54d expref: 402 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.933698:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.933701:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.933705:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a54d expref: 402 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.933714:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44a00, rc 0) 00000100:00100000:1.0:1769074923.933789:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67404:x1855007616094848:12345-192.168.204.32@tcp:101:rm.0 Request processed in 622us (846us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.933798:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9405 00000100:00100000:3.0:1769074923.937902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074923.938018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074923.938272:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095104 00000100:00100000:2.0:1769074923.938287:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095104 00000100:00100000:2.0:1769074923.938369:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:2.0:1769074923.938381:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:2419:x1855007616095104:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074923.938434:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074923.938461:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9c28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a55b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.938576:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.938596:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938608:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938625:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074923.938631:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938638:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938710:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938718:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938725:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938732:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.938737:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938746:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938760:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.938764:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.938770:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938776:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9c2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938947:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938953:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938959:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938965:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074923.938968:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938975:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938983:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074923.938986:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074923.938990:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.938995:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9c36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074923.939033:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9c28 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a55b expref: 402 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.939044:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074923.939046:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074923.939050:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9c28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a55b expref: 402 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074923.939059:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc -2) 00000100:00100000:2.0:1769074923.939163:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:2419:x1855007616095104:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 783us (1143us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074923.939180:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:0.0:1769074923.941316:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616094976 00000100:00100000:0.0:1769074923.941403:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616094976 00000100:00100000:0.0:1769074923.941705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9406 00000100:00100000:0.0:1769074923.941719:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67404:x1855007616094976:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074923.941743:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.941771:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a554 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.941875:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.941892:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.941904:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.941919:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.941925:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.941931:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.941999:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942006:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942013:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942020:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.942025:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942032:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942044:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.942047:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.942052:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942058:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942073:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942078:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942083:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942088:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.942090:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942095:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942101:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.942104:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.942107:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942112:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.942149:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c3d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a554 expref: 402 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.942159:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.942161:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.942165:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a554 expref: 402 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.942187:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074923.942481:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67404:x1855007616094976:12345-192.168.204.32@tcp:101:rm.0 Request processed in 763us (4957us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.942489:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9406 00000100:00100000:3.0:1769074923.960222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.960362:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095232 00000100:00100000:0.0:1769074923.960376:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095232 00000100:00100000:0.0:1769074923.960460:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9407 00000100:00100000:0.0:1769074923.960471:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67405:x1855007616095232:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.960510:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.960582:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c52 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a562 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.960681:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.960701:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960716:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960732:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.960739:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960745:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960817:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960826:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960834:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960839:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.960844:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960853:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960867:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.960870:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.960876:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960881:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c59 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960898:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960904:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960909:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960913:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.960916:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960921:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960927:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.960930:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.960933:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960938:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c60 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.960977:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c52 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a562 expref: 402 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.960987:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.960989:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.960993:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c52 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a562 expref: 402 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.961009:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074923.961101:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67405:x1855007616095232:12345-192.168.204.32@tcp:101:cp.0 Request processed in 631us (898us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074923.961109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9407 00000100:00100000:2.0:1769074923.965400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.965516:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095360 00000100:00100000:1.0:1769074923.965580:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095360 00000100:00100000:1.0:1769074923.965651:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9408 00000100:00100000:1.0:1769074923.965663:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67405:x1855007616095360:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.965691:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.965719:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c67 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a569 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.965810:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.965828:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965842:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965862:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074923.965869:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965875:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965947:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965954:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965960:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965966:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965972:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.965977:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965985:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.965999:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.966003:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.966009:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966016:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9c6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966044:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966050:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966055:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966060:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074923.966062:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966068:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966075:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff916052708c00) 00010000:00010000:1.0:1769074923.966077:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.966079:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966085:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9c75 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074923.966125:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c67 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a569 expref: 402 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.966146:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074923.966148:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074923.966151:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fe9c67 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a569 expref: 402 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.966162:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44a00, rc 0) 00000100:00100000:1.0:1769074923.966250:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67405:x1855007616095360:12345-192.168.204.32@tcp:101:cp.0 Request processed in 589us (866us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074923.966259:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9408 00000100:00100000:3.0:1769074923.971698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.972075:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095616 00000100:00100000:0.0:1769074923.972092:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095616 00000100:00100000:0.0:1769074923.972584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9409 00000100:00100000:0.0:1769074923.972598:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67405:x1855007616095616:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.972628:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.972658:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c7c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a570 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.972907:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.972925:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.972939:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.972955:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x85878570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.972961:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.972968:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:0.0:1769074923.974026:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb4:0x0], index 0: 0 00010000:00010000:0.0:1769074923.974707:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9c91 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074923.974726:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9c91 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.974736:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9c91 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.974972:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.974983:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.974990:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.974997:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074923.975003:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.975012:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.975026:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074923.975030:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074923.975037:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.975044:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9c83 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:0.0:1769074923.975066:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca49684c reply state 000000000dec6f11 transno 4294969025 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.975078:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074923.975085:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff91604e0d3100) 00010000:00010000:0.0:1769074923.975088:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074923.975092:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074923.975243:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9c7c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a570 expref: 404 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.975262:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb000/0x557988ac98fe9c91 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a570 expref: 403 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.975271:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x172:0x0].0x0 (ffff91604e0d3c00) 00010000:00010000:0.0:1769074923.975274:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074923.975277:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb000, rc 0) 00000100:00100000:0.0:1769074923.975724:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67405:x1855007616095616:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3126us (4039us total) trans 4294969025 rc 0/0 00000100:00100000:0.0:1769074923.975736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9409 00000100:00100000:3.0:1769074923.979223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.979429:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095744 00000100:00100000:1.0:1769074923.979444:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095744 00000100:00100000:1.0:1769074923.979752:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2713 00000100:00100000:1.0:1769074923.979765:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2419:x1855007616095744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074923.979802:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074923.979833:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a577 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074923.979863:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074923.979893:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.979896:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.979907:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 160 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.979927:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 160 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074923.979944:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44a00, rc 0) 00000100:00100000:1.0:1769074923.980029:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2419:x1855007616095744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 266us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.980036:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2713 00000100:00100000:2.0:1769074923.983304:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.983456:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616095872 00000100:00100000:0.0:1769074923.983471:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616095872 00000100:00100000:0.0:1769074923.983573:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2714 00000100:00100000:0.0:1769074923.983585:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:67405:x1855007616095872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074923.983612:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074923.983637:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a57e expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.983683:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 161 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074923.983693:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.983695:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074923.983700:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a57e expref: 161 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.983748:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 161 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074923.983765:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 161 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074923.983793:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626622336:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074923.983924:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044ff2600 going to sleep for 11 seconds 00000100:00100000:3.0:1769074923.987107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074923.987226:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096000 00000100:00100000:1.0:1769074923.987239:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096000 00010000:00010000:1.0:1769074923.987314:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 162 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074923.987377:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1884 00000100:00100000:1.0:1769074923.987389:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2420:x1855007616096000:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074923.987411:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074923.987439:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 162 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:1.0:1769074923.987456:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 162 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:1.0:1769074923.987490:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.987493:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074923.987501:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a57e expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.987514:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a57e expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074923.987603:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a57e expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074923.987621:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626622464:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074923.987719:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f93c0 going to sleep for 11 seconds 00010000:00010000:0.0:1769074923.987995:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052a44a00/0x557988ac98fe9c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a577 expref: 162 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074923.988023:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626622336:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074923.988053:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ebfba00/0x557988ac98fe9ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a57e expref: 161 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074923.988064:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfba00, rc 0) 00000100:00100000:0.0:1769074923.988115:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:67405:x1855007616095872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4532us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074923.988125:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2714 00000100:00100000:3.0:1769074923.993014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074923.993148:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096256 00000100:00100000:0.0:1769074923.993160:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096256 00000100:00100000:0.0:1769074923.993279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1869 00000100:00100000:0.0:1769074923.993292:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67405:x1855007616096256:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074923.993748:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67405:x1855007616096256:12345-192.168.204.32@tcp:35:cp.0 Request processed in 456us (746us total) trans 4294969026 rc 0/0 00000100:00100000:0.0:1769074923.993759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1869 00000100:00100000:1.0:1769074923.994619:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626622464:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074923.994656:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074923.994717:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2420:x1855007616096000:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7328us (7624us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074923.994727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1884 00000100:00100000:3.0:1769074924.029731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.029863:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096384 00000100:00100000:0.0:1769074924.029880:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096384 00000100:00100000:0.0:1769074924.029959:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9410 00000100:00100000:0.0:1769074924.029970:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67408:x1855007616096384:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074924.029999:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.030030:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9cad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a585 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.030121:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.030140:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030153:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030179:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.030187:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030196:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030276:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030285:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030291:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030298:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.030303:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030311:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.030326:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.031127:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.031139:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031148:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9cb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031180:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031187:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031194:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031201:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.031204:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031211:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031225:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff91604e0d3200) 00010000:00010000:0.0:1769074924.031228:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.031231:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031237:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9cbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.031289:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9cad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a585 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.031301:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.031303:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.031306:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9cad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a585 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.031316:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074924.031711:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67408:x1855007616096384:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1738us (1991us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.031722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9410 00000100:00100000:3.0:1769074924.041148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.041203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.041276:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096640 00000100:00100000:1.0:1769074924.041290:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096640 00000100:00100000:1.0:1769074924.041363:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:1.0:1769074924.041374:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:2418:x1855007616096640:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074924.041430:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.041456:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9cc2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a593 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.041561:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074924.041578:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041591:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041609:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074924.041615:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041621:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041695:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041704:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041710:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041715:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.041720:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041732:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041745:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.041749:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.041755:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041761:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fe9cc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041802:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041808:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041814:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041819:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.041822:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041828:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041835:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff916052708800) 00010000:00010000:1.0:1769074924.041838:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.041841:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041846:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9cd0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.041882:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9cc2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a593 expref: 406 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.041892:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.041895:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074924.041898:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45e00/0x557988ac98fe9cc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a593 expref: 406 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.041909:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45e00, rc -2) 00000100:00100000:1.0:1769074924.041995:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:2418:x1855007616096640:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 622us (790us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074924.042005:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:0.0:1769074924.042270:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096512 00000100:00100000:0.0:1769074924.042278:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096512 00000100:00100000:0.0:1769074924.042327:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9411 00000100:00100000:0.0:1769074924.042335:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67409:x1855007616096512:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074924.042346:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.042361:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9cd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a58c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.042408:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.042418:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042426:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042440:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.042446:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042451:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042485:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042504:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042511:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042515:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.042519:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042524:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042554:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.042557:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.042560:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042565:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9cde lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042576:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042581:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042587:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042591:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.042594:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042599:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042606:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.042609:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.042611:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042620:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9ce5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.042645:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9cd7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a58c expref: 406 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.042654:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.042657:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.042660:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9cd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a58c expref: 406 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.042671:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb400, rc 0) 00000100:00100000:0.0:1769074924.042710:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67409:x1855007616096512:12345-192.168.204.32@tcp:101:rm.0 Request processed in 376us (1575us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.042717:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9411 00000100:00100000:3.0:1769074924.049474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.049641:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096768 00000100:00100000:1.0:1769074924.049656:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096768 00000100:00100000:1.0:1769074924.049727:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9412 00000100:00100000:1.0:1769074924.049737:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67409:x1855007616096768:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074924.049766:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.049805:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9cec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a59a expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.049897:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.049915:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.049928:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.049951:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.049957:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.049964:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050038:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050046:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050051:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050057:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050063:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.050068:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050075:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050088:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.050091:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.050097:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050103:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9cf3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050131:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050137:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050143:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050147:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.050150:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050156:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050163:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff916052708a00) 00010000:00010000:1.0:1769074924.050165:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.050178:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050183:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9cfa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.050224:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9cec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a59a expref: 406 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.050234:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.050236:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.050240:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9cec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a59a expref: 406 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.050255:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45400, rc 0) 00000100:00100000:1.0:1769074924.050340:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67409:x1855007616096768:12345-192.168.204.32@tcp:101:rm.0 Request processed in 603us (882us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.050348:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9412 00000100:00100000:3.0:1769074924.065034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.065161:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616096896 00000100:00100000:0.0:1769074924.065184:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616096896 00000100:00100000:0.0:1769074924.065270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9413 00000100:00100000:0.0:1769074924.065282:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67410:x1855007616096896:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.065312:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.065351:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9d01 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.065451:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.065471:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065488:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065516:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:0.0:1769074924.065522:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065579:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065651:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065659:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065667:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065674:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.065678:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065686:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065700:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.065703:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.065709:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065715:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9d08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065729:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065735:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065740:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065745:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.065748:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065754:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065760:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.065763:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.065765:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065771:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9d0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.065806:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9d01 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5a1 expref: 406 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.065817:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.065819:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.065823:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9d01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5a1 expref: 406 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.065839:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb400, rc 0) 00000100:00100000:0.0:1769074924.065919:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67410:x1855007616096896:12345-192.168.204.32@tcp:101:cp.0 Request processed in 639us (900us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.065928:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9413 00000100:00100000:3.0:1769074924.070219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.070349:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097024 00000100:00100000:1.0:1769074924.070362:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097024 00000100:00100000:1.0:1769074924.070476:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9414 00000100:00100000:1.0:1769074924.070489:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67410:x1855007616097024:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074924.070562:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.070592:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9d16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5a8 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.070688:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.070707:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070721:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070740:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.070747:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070752:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070839:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070847:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070853:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070860:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070894:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.070900:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070908:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070922:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.070926:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.070931:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070936:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070956:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070962:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070967:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070973:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.070976:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070981:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070988:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff916052708a00) 00010000:00010000:1.0:1769074924.070989:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.070992:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.070998:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.071047:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9d16 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5a8 expref: 406 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.071060:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.071062:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.071066:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fe9d16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5a8 expref: 406 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.071075:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45400, rc 0) 00000100:00100000:1.0:1769074924.071161:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67410:x1855007616097024:12345-192.168.204.32@tcp:101:cp.0 Request processed in 674us (958us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.071178:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9414 00000100:00100000:3.0:1769074924.074683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.074828:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097280 00000100:00100000:2.0:1769074924.074843:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097280 00000100:00100000:2.0:1769074924.074925:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9415 00000100:00100000:2.0:1769074924.074937:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67410:x1855007616097280:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074924.074966:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.074994:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9d2b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5af expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.075152:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074924.075179:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075191:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075209:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074924.075216:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075222:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074924.075684:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb5:0x0], index 1: 0 00010000:00010000:2.0:1769074924.075880:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9d40 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074924.075892:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9d40 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075900:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9d40 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075944:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075952:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075958:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075971:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075977:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.075982:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.075990:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.076004:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.076008:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.076012:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.076019:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9d32 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074924.076037:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b3d32ec reply state 0000000095eafb18 transno 4294969027 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.076048:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074924.076054:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074924.076057:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074924.076060:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074924.076099:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9d2b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5af expref: 408 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.076116:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e200/0x557988ac98fe9d40 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5af expref: 407 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.076128:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x173:0x0].0x0 (ffff91604f4f6800) 00010000:00010000:2.0:1769074924.076131:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074924.076133:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e200, rc 0) 00000100:00100000:2.0:1769074924.076244:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67410:x1855007616097280:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1308us (1576us total) trans 4294969027 rc 0/0 00000100:00100000:2.0:1769074924.076253:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9415 00000100:00100000:3.0:1769074924.079943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.080116:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097408 00000100:00100000:0.0:1769074924.080129:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097408 00000100:00100000:0.0:1769074924.080213:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2715 00000100:00100000:0.0:1769074924.080226:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+158:2418:x1855007616097408:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.080250:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.080277:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5b6 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074924.080309:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074924.080344:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.080346:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.080356:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 159 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.080377:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 159 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.080393:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074924.080455:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2418:x1855007616097408:12345-192.168.204.32@tcp:101:cp.0 Request processed in 232us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074924.080463:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2715 00000100:00100000:2.0:1769074924.084453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.084719:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097536 00000100:00100000:1.0:1769074924.084733:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097536 00000100:00100000:1.0:1769074924.084813:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2716 00000100:00100000:1.0:1769074924.084825:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:67410:x1855007616097536:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074924.084851:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.084875:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5bd expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.084920:0:8625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.084929:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.084932:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.084936:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5bd expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.084983:0:8625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.085002:0:8625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074924.085019:0:8625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626622592:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074924.085151:0:8625:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074924.088897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.089084:0:8625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1855007626622592:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074924.089127:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5bd expref: 160 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.089154:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45e00, rc 0) 00000100:00100000:1.0:1769074924.089241:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:67410:x1855007616097536:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4417us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074924.089252:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2716 00000100:00100000:0.0:1769074924.089517:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097664 00000100:00100000:0.0:1769074924.089526:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097664 00010000:00010000:0.0:1769074924.089629:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074924.089665:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1885 00000100:00100000:0.0:1769074924.089674:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2420:x1855007616097664:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074924.089690:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074924.089717:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074924.089731:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074924.089761:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9d4e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5b6 expref: 160 pid: 24564 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074924.089787:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.089790:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.089799:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5bd expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.089809:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5bd expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.089850:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052a45e00/0x557988ac98fe9d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5bd expref: 159 pid: 8625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074924.089872:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626622720:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074924.089954:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044ff2600 going to sleep for 11 seconds 00000100:00100000:0.0:1769074924.094486:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626622720:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074924.094587:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074924.094662:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2420:x1855007616097664:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4986us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074924.094676:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1885 00000100:00100000:1.0:1769074924.099120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.099290:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616097920 00000100:00100000:3.0:1769074924.099305:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616097920 00000100:00100000:3.0:1769074924.099393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1870 00000100:00100000:3.0:1769074924.099405:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67410:x1855007616097920:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074924.100322:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67410:x1855007616097920:12345-192.168.204.32@tcp:35:cp.0 Request processed in 914us (1213us total) trans 4294969028 rc 0/0 00000100:00100000:3.0:1769074924.100333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1870 00000100:00100000:2.0:1769074924.139721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.139958:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098048 00000100:00100000:1.0:1769074924.139972:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098048 00000100:00100000:1.0:1769074924.140040:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9416 00000100:00100000:1.0:1769074924.140049:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67414:x1855007616098048:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074924.140073:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.140100:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5c4 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.140203:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.140223:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140238:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140257:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.140264:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140271:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140342:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140355:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140363:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140370:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140376:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.140381:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140390:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140405:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.140408:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.140413:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140420:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9d63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140439:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140444:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140448:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140453:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.140457:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140462:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140467:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff916052708a00) 00010000:00010000:1.0:1769074924.140469:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.140472:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140476:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9d6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.140522:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d5c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5c4 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.140575:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.140578:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.140582:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5c4 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.140592:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.140676:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67414:x1855007616098048:12345-192.168.204.32@tcp:101:bash.0 Request processed in 627us (970us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.140683:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9416 00000100:00100000:0.0:1769074924.157426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.157658:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098176 00000100:00100000:3.0:1769074924.157672:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098176 00000100:00100000:3.0:1769074924.157760:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9417 00000100:00100000:3.0:1769074924.157773:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67415:x1855007616098176:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074924.157818:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.157850:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9d71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5cb expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.157949:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.157970:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.157983:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158004:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.158012:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158019:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158090:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158099:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158106:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158114:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.158118:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158126:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158141:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.158145:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.158195:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158203:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9d78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158219:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158225:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158231:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158236:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a75a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.158240:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158246:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158254:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff91604f42aa00) 00010000:00010000:3.0:1769074924.158257:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.158259:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158265:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9d7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.158303:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9d71 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5cb expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.158314:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.158316:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.158320:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9d71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5cb expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.158341:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074924.158430:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67415:x1855007616098176:12345-192.168.204.32@tcp:101:rm.0 Request processed in 660us (1019us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.158438:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9417 00000100:00100000:2.0:1769074924.165115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.165217:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098304 00000100:00100000:3.0:1769074924.165231:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098304 00000100:00100000:3.0:1769074924.165315:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:3.0:1769074924.165335:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2418:x1855007616098304:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074924.165390:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.165417:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9d86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5d2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.165492:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074924.165512:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165525:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165577:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074924.165585:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165591:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165665:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165673:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165680:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165695:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.165700:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165709:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165723:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.165727:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.165733:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165739:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9d8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165755:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165761:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165766:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165772:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.165774:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165790:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165798:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604f42ab00) 00010000:00010000:3.0:1769074924.165801:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.165805:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165810:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9d94 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074924.165847:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9d86 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5d2 expref: 410 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.165858:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.165860:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074924.165863:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9d86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5d2 expref: 410 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.165893:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7400, rc -2) 00000100:00100000:3.0:1769074924.166009:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2418:x1855007616098304:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 685us (910us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074924.166018:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:0.0:1769074924.169654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.169772:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098432 00000100:00100000:1.0:1769074924.169797:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098432 00000100:00100000:1.0:1769074924.169870:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9418 00000100:00100000:1.0:1769074924.169881:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67415:x1855007616098432:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074924.169912:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.169940:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d9b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5d9 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.170027:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.170044:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170056:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170073:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.170079:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170084:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170151:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170158:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170164:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170181:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170187:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.170192:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170199:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170212:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.170216:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.170221:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170227:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9da2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170252:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170257:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170262:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170266:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.170269:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170275:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170281:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff916052708a00) 00010000:00010000:1.0:1769074924.170284:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.170286:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170296:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9da9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.170331:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d9b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5d9 expref: 410 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.170341:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.170342:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.170346:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9d9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5d9 expref: 410 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.170354:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.170433:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67415:x1855007616098432:12345-192.168.204.32@tcp:101:rm.0 Request processed in 553us (796us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.170441:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9418 00000100:00100000:2.0:1769074924.188078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.188271:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098560 00000100:00100000:3.0:1769074924.188286:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098560 00000100:00100000:2.0:1769074924.188753:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9419 00000100:00100000:2.0:1769074924.188767:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67416:x1855007616098560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074924.188809:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.188843:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe9db0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5e0 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.188936:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074924.188954:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.188966:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.188982:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074924.188993:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.188999:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189070:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189077:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189083:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189089:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.189094:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189100:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189113:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.189117:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.189122:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189128:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fe9db7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189144:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189149:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189155:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189159:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.189162:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189181:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189188:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff91604f4f6200) 00010000:00010000:2.0:1769074924.189190:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.189193:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189199:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9dbe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074924.189234:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe9db0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5e0 expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.189244:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.189246:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.189250:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fe9db0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5e0 expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.189259:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:2.0:1769074924.190053:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67416:x1855007616098560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1282us (1986us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074924.190065:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9419 00000100:00100000:2.0:1769074924.196317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.196732:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098688 00000100:00100000:0.0:1769074924.196746:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098688 00000100:00100000:0.0:1769074924.196945:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9420 00000100:00100000:0.0:1769074924.196957:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67416:x1855007616098688:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.196984:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.197007:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9dc5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5e7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.197098:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.197117:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197131:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197146:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.197154:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197161:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197253:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197262:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197268:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197275:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.197280:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197288:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197304:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.197308:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.197314:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197320:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbc00/0x557988ac98fe9dcc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197435:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197442:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197448:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197454:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.197457:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197463:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197472:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.197475:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.197478:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197484:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9dd3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.197867:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9dc5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5e7 expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.197881:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.197884:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.197888:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9dc5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5e7 expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.197899:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074924.198115:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67416:x1855007616098688:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1157us (1812us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.198125:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9420 00000100:00100000:2.0:1769074924.206087:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.206199:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616098944 00000100:00100000:3.0:1769074924.206214:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616098944 00000100:00100000:3.0:1769074924.206357:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9421 00000100:00100000:3.0:1769074924.206370:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67416:x1855007616098944:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.206404:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.206433:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9dda lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5ee expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.206788:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.206813:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.206825:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.206846:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.206852:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.206858:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074924.207276:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb5:0x0], index 0: 0 00010000:00010000:3.0:1769074924.207852:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9def lrc: 3/1,0 mode: --/PR res: [0x240000403:0x174:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.207868:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9def lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207875:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9def lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207921:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207929:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207937:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207947:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.207951:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207959:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207973:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.207977:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.207981:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.207987:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9de1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074924.208001:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000058865b03 reply state 0000000055bc219d transno 4294969029 ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.208012:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.208017:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff91604f42ab00) 00010000:00010000:3.0:1769074924.208019:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074924.208022:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074924.208065:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9dda lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5ee expref: 412 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.208081:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a75a00/0x557988ac98fe9def lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5ee expref: 411 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.208088:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x174:0x0].0x0 (ffff91604f42aa00) 00010000:00010000:3.0:1769074924.208091:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074924.208094:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a75a00, rc 0) 00000100:00100000:3.0:1769074924.208289:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67416:x1855007616098944:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1920us (2215us total) trans 4294969029 rc 0/0 00000100:00100000:3.0:1769074924.208299:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9421 00000100:00100000:2.0:1769074924.213185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.213315:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099072 00000100:00100000:1.0:1769074924.213425:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099072 00000100:00100000:1.0:1769074924.213732:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2717 00000100:00100000:1.0:1769074924.213745:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2419:x1855007616099072:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074924.213770:0:8625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.213807:0:8625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5f5 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074924.213838:0:8625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074924.213863:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.213865:0:8625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.213875:0:8625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 161 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.213898:0:8625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 161 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.213913:0:8625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.213989:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2419:x1855007616099072:12345-192.168.204.32@tcp:101:cp.0 Request processed in 246us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074924.213996:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2717 00000100:00100000:2.0:1769074924.216991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.217461:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099200 00000100:00100000:0.0:1769074924.217475:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099200 00000100:00100000:0.0:1769074924.217571:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2718 00000100:00100000:0.0:1769074924.217583:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:67416:x1855007616099200:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.217608:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.217631:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a5fc expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.217671:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 162 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.217681:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.217683:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.217687:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5fc expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.217731:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 162 pid: 8625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.217748:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 162 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074924.217765:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626622848:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074924.218102:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044ff2600 going to sleep for 11 seconds 00000100:00100000:2.0:1769074924.226277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.227012:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099328 00000100:00100000:3.0:1769074924.227026:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099328 00010000:00010000:3.0:1769074924.227104:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 163 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:3.0:1769074924.227164:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1886 00000100:00100000:3.0:1769074924.227185:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2420:x1855007616099328:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074924.227206:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074924.227234:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 163 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:3.0:1769074924.227249:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 163 pid: 8625 timeout: 2013 lvb_type: 1 00010000:00010000:3.0:1769074924.227282:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.227284:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.227294:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5fc expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.227307:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5fc expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.227369:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5fc expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074924.227388:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043559500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626622976:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074924.227493:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043c70600 going to sleep for 11 seconds 00010000:00010000:1.0:1769074924.229694:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052a44e00/0x557988ac98fe9dfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5f5 expref: 163 pid: 8625 timeout: 2013 lvb_type: 1 00000100:00100000:1.0:1769074924.229734:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626622848:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074924.229787:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ebfbc00/0x557988ac98fe9e04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a5fc expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.229805:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbc00, rc 0) 00000100:00100000:1.0:1769074924.229905:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:67416:x1855007616099200:12345-192.168.204.32@tcp:101:cp.0 Request processed in 12324us (12927us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074924.229916:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2718 00000100:00100000:3.0:1769074924.233420:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043559500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626622976:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074924.233457:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074924.233528:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2420:x1855007616099328:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6344us (7265us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.233563:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1886 00000100:00100000:2.0:1769074924.235939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.235993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.236037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.236075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.236111:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099968 00000100:00100000:2.0:1769074924.236123:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099968 00000100:00080000:2.0:1769074924.236157:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1769074924.236227:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099840 00000100:00100000:2.0:1769074924.236232:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099840 00000100:00080000:2.0:1769074924.236247:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1769074924.236277:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3142 00000100:00100000:2.0:1769074924.236289:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616099968:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074924.236402:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616099968:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.236410:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3142 00000100:00100000:2.0:1769074924.236430:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3143 00000100:00100000:2.0:1769074924.236436:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616099840:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074924.236462:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616099840:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.236468:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3143 00000100:00100000:0.0:1769074924.236755:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099712 00000100:00100000:0.0:1769074924.236761:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099712 00000100:00100000:0.0:1769074924.236807:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 273 00000100:00100000:0.0:1769074924.236814:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616099712:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074924.236856:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616099712:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 42us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074924.236862:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 273 00000100:00100000:3.0:1769074924.237762:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616099584 00000100:00100000:3.0:1769074924.237771:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616099584 00000100:00100000:2.0:1769074924.238725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1871 00000100:00100000:2.0:1769074924.238738:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67416:x1855007616099584:12345-192.168.204.32@tcp:35:cp.0 00000001:00080000:2.0:1769074924.239068:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969030 00000100:00100000:2.0:1769074924.239226:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67416:x1855007616099584:12345-192.168.204.32@tcp:35:cp.0 Request processed in 489us (3299us total) trans 4294969031 rc 0/0 00000100:00100000:2.0:1769074924.239235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1871 00000020:00080000:2.0:1769074924.239241:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1769074924.273120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.273247:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100096 00000100:00100000:1.0:1769074924.273261:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100096 00000100:00100000:1.0:1769074924.273344:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9422 00000100:00100000:1.0:1769074924.273356:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67419:x1855007616100096:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074924.273387:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.273415:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e0b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a603 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.273512:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074924.273578:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273593:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273614:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074924.273621:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273628:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273695:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273703:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273708:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273714:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.273719:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273727:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273744:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.273747:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.273753:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273760:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273775:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273781:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273786:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273791:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.273793:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273799:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273807:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916052708400) 00010000:00010000:1.0:1769074924.273809:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.273812:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273818:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074924.273867:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e0b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a603 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.273879:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.273882:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.273885:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e0b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a603 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.273895:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.273987:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67419:x1855007616100096:12345-192.168.204.32@tcp:101:bash.0 Request processed in 633us (882us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.273995:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9422 00000100:00100000:3.0:1769074924.286931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.286987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.287107:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100224 00000100:00100000:1.0:1769074924.287121:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100224 00000100:00100000:1.0:1769074924.287205:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9423 00000100:00100000:1.0:1769074924.287217:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67420:x1855007616100224:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074924.287250:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.287277:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e20 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a60a expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.287373:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.287391:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287405:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287424:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.287434:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287440:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287505:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287511:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287517:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287523:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287564:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.287570:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287577:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287591:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.287595:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.287601:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287607:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9e27 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287634:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287640:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287645:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287650:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.287653:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287658:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287665:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916052708400) 00010000:00010000:1.0:1769074924.287668:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.287670:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287677:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fe9e2e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.287714:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e20 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a60a expref: 415 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.287725:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.287727:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.287731:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fe9e20 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a60a expref: 415 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.287742:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.287816:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67420:x1855007616100224:12345-192.168.204.32@tcp:101:rm.0 Request processed in 601us (897us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.287825:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9423 00000100:00100000:0.0:1769074924.288012:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100352 00000100:00100000:0.0:1769074924.288019:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100352 00000100:00100000:0.0:1769074924.288064:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:0.0:1769074924.288071:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:2418:x1855007616100352:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074924.288119:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.288130:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e35 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a611 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.288177:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074924.288189:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288198:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288211:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074924.288217:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288222:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288250:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288260:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288265:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288269:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.288273:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288278:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288285:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.288288:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.288291:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288297:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288309:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288314:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288319:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288324:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.288326:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288334:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288340:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.288342:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.288344:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288349:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e43 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.288367:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e35 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a611 expref: 415 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.288374:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.288376:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074924.288379:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e35 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a611 expref: 415 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.288386:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc -2) 00000100:00100000:0.0:1769074924.288421:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:2418:x1855007616100352:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 350us (1432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074924.288428:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:1.0:1769074924.293903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.294137:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100480 00000100:00100000:3.0:1769074924.294152:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100480 00000100:00100000:3.0:1769074924.294258:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9424 00000100:00100000:3.0:1769074924.294270:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67420:x1855007616100480:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074924.294299:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.294335:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a649 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.294432:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.294450:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294464:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294486:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.294502:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294508:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294608:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294616:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294622:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294629:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.294633:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294642:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294656:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.294660:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.294666:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294672:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e51 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294687:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294694:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294700:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294704:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.294707:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294712:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294719:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916174a68600) 00010000:00010000:3.0:1769074924.294722:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.294724:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294729:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e58 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.294769:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e4a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a649 expref: 415 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.294797:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.294799:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.294804:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a649 expref: 415 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.294813:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ac00, rc 0) 00000100:00100000:3.0:1769074924.294897:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67420:x1855007616100480:12345-192.168.204.32@tcp:101:rm.0 Request processed in 628us (1007us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.294905:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9424 00000100:00100000:1.0:1769074924.312720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.312804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.312915:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100736 00000100:00100000:0.0:1769074924.312930:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100736 00000100:00100000:0.0:1769074924.313010:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:0.0:1769074924.313023:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:2418:x1855007616100736:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074924.313100:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.313139:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e5f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a657 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.313251:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.313270:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313284:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313300:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.313307:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313314:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313383:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313391:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313398:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313404:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.313409:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313417:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313433:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.313436:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.313443:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313449:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9e66 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313465:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313470:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313475:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313480:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.313482:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313487:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313494:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.313496:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.313499:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313505:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9e6d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.313598:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e5f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a657 expref: 415 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.313609:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.313612:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074924.313615:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9e5f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a657 expref: 415 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.313625:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc -2) 00000100:00100000:0.0:1769074924.313710:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:2418:x1855007616100736:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 689us (904us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074924.313718:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:3.0:1769074924.314637:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100608 00000100:00100000:3.0:1769074924.314649:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100608 00000100:00100000:3.0:1769074924.314714:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9425 00000100:00100000:3.0:1769074924.314724:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67423:x1855007616100608:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.314742:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.314763:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e74 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a650 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.315065:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074924.315081:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315090:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315109:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074924.315115:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315120:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315189:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315197:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315204:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315211:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315216:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.315220:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315228:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315241:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.315244:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.315249:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315255:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7600/0x557988ac98fe9e7b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315268:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315273:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315279:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315284:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a8ac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.315286:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315295:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315301:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916174a68600) 00010000:00010000:3.0:1769074924.315304:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.315307:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315312:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9e82 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.315344:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e74 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a650 expref: 415 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.315354:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.315357:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.315360:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9e74 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a650 expref: 415 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.315369:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074924.315449:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67423:x1855007616100608:12345-192.168.204.32@tcp:101:cp.0 Request processed in 726us (2747us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.315458:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9425 00000100:00100000:0.0:1769074924.320316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.320468:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616100864 00000100:00100000:3.0:1769074924.320482:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616100864 00000100:00100000:3.0:1769074924.320588:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9426 00000100:00100000:3.0:1769074924.320600:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67423:x1855007616100864:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.320628:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.320655:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e89 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a68f expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.320743:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.320762:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.320949:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.320970:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.320978:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.320984:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321051:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321059:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321066:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321073:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.321077:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321086:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321100:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.321104:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.321109:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321116:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9e90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321130:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321136:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321142:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321147:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.321150:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321155:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321162:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916174a68a00) 00010000:00010000:3.0:1769074924.321176:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.321180:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321186:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e97 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.321223:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e89 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a68f expref: 415 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.321236:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.321239:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.321243:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9e89 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a68f expref: 415 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.321253:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ae00, rc 0) 00000100:00100000:3.0:1769074924.321728:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67423:x1855007616100864:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1126us (1424us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.321737:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9426 00000100:00100000:2.0:1769074924.332351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.332442:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101120 00000100:00100000:3.0:1769074924.332456:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101120 00000100:00100000:3.0:1769074924.332589:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9427 00000100:00100000:3.0:1769074924.332602:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67423:x1855007616101120:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.332631:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.332661:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e9e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a696 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.332838:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.332857:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.332871:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.332891:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x6697a92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.332903:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.332910:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074924.333323:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb6:0x0], index 1: 0 00010000:00010000:3.0:1769074924.333566:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9eb3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x175:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.333577:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9eb3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333585:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9eb3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333627:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333635:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333642:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333648:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.333653:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333660:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333675:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.333679:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.333685:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333691:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9ea5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074924.333706:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1b9a6e4 reply state 000000000fbb6476 transno 4294969032 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333718:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.333724:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916174a68a00) 00010000:00010000:3.0:1769074924.333726:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074924.333729:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074924.333768:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9e9e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a696 expref: 417 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.333783:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a8ae00/0x557988ac98fe9eb3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a696 expref: 416 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.333791:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x175:0x0].0x0 (ffff916174a68600) 00010000:00010000:3.0:1769074924.333793:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074924.333796:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ae00, rc 0) 00000100:00100000:3.0:1769074924.333883:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67423:x1855007616101120:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1284us (1556us total) trans 4294969032 rc 0/0 00000100:00100000:3.0:1769074924.333892:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9427 00000100:00100000:2.0:1769074924.338599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.338829:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101248 00000100:00100000:1.0:1769074924.338843:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101248 00000100:00100000:1.0:1769074924.338913:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2719 00000100:00100000:1.0:1769074924.338923:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+159:2420:x1855007616101248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074924.338948:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.338974:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a69d expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074924.339004:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074924.339027:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.339029:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074924.339039:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 160 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.339057:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 160 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074924.339073:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074924.339153:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2420:x1855007616101248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 231us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074924.339160:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2719 00000100:00100000:0.0:1769074924.343214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.343437:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101376 00000100:00100000:3.0:1769074924.343450:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101376 00000100:00100000:3.0:1769074924.343577:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2720 00000100:00100000:3.0:1769074924.343590:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:67423:x1855007616101376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.343615:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.343640:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6a4 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.343678:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 161 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.343687:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.343689:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.343694:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6a4 expref: 161 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.343742:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 161 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.343757:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 161 pid: 24564 timeout: 2013 lvb_type: 1 00000100:00100000:3.0:1769074924.343773:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626623104:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074924.343913:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074924.348442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.348706:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101504 00000100:00100000:0.0:1769074924.348718:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101504 00010000:00010000:0.0:1769074924.348793:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 162 pid: 24564 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074924.348843:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1887 00000100:00100000:0.0:1769074924.348854:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2419:x1855007616101504:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074924.348872:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074924.348898:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 162 pid: 24564 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074924.348914:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 162 pid: 24564 timeout: 2013 lvb_type: 1 00010000:00010000:0.0:1769074924.348952:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.348955:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.348964:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6a4 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.348976:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6a4 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.349024:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6a4 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074924.349041:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626623232:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074924.349174:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916044ff2d80 going to sleep for 11 seconds 00010000:00010000:3.0:1769074924.349765:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fe9ec1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a69d expref: 162 pid: 24564 timeout: 2013 lvb_type: 1 00000100:00100000:3.0:1769074924.349794:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626623104:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074924.349825:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a8ac00/0x557988ac98fe9ec8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6a4 expref: 161 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.349844:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a8ac00, rc 0) 00000100:00100000:3.0:1769074924.349905:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:67423:x1855007616101376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6317us (6705us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.349915:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2720 00000100:00100000:2.0:1769074924.356315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.356428:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101760 00000100:00100000:1.0:1769074924.356444:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101760 00000100:00100000:1.0:1769074924.356568:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1872 00000100:00100000:1.0:1769074924.356582:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67423:x1855007616101760:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074924.357011:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67423:x1855007616101760:12345-192.168.204.32@tcp:35:cp.0 Request processed in 430us (710us total) trans 4294969033 rc 0/0 00000100:00100000:1.0:1769074924.357020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1872 00000100:00100000:0.0:1769074924.357967:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626623232:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074924.357999:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074924.358057:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2419:x1855007616101504:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9205us (9629us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074924.358069:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1887 00000100:00100000:2.0:1769074924.387418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.387578:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616101888 00000100:00100000:1.0:1769074924.387592:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616101888 00000100:00100000:1.0:1769074924.387659:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00100000:1.0:1769074924.387670:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:2417:x1855007616101888:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074924.387747:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.387787:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ecf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6ab expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.387866:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074924.387884:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.387897:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.387914:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074924.387921:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.387927:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388002:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388010:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388017:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388024:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.388028:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388037:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388051:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.388054:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.388060:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388066:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ed6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388081:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388087:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388092:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388097:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.388100:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388105:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388112:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff916052708f00) 00010000:00010000:1.0:1769074924.388114:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.388117:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388121:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9edd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074924.388319:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ecf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ab expref: 419 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.388330:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.388333:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074924.388336:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ecf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ab expref: 419 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.388355:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc -2) 00000100:00100000:1.0:1769074924.388447:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:2417:x1855007616101888:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 777us (1043us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074924.388456:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00100000:2.0:1769074924.400285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.401019:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102016 00000100:00100000:1.0:1769074924.401035:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102016 00000100:00100000:1.0:1769074924.401113:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9428 00000100:00100000:1.0:1769074924.401125:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67430:x1855007616102016:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074924.401158:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.401197:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ee4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6e3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.401301:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.401320:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.401707:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.401728:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.401736:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.401743:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402019:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402028:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402034:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402041:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402048:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.402054:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402062:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402077:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.402081:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.402086:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402093:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9eeb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402113:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402119:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402125:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402130:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.402133:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402139:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402145:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff916052708f00) 00010000:00010000:1.0:1769074924.402148:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.402150:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402159:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9ef2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.402215:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ee4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6e3 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.402226:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.402228:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.402232:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9ee4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6e3 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.402251:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074924.403108:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67430:x1855007616102016:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1977us (2831us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.403120:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9428 00000100:00100000:3.0:1769074924.416465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.416578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.416750:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102272 00000100:00100000:0.0:1769074924.416765:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102272 00000100:00100000:0.0:1769074924.416864:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 170 00000100:00100000:0.0:1769074924.416876:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:2418:x1855007616102272:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074924.416927:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.416953:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9ef9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6f1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.417035:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.417053:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417068:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417085:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.417091:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417096:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417174:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417182:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417190:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417197:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.417202:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417210:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417228:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.417232:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.417238:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417243:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9f00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417260:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417266:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417271:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417277:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.417279:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417285:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417292:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.417294:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.417297:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417302:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fe9f07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.417349:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9ef9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6f1 expref: 419 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.417360:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.417363:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074924.417366:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9ef9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6f1 expref: 419 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.417375:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa800, rc -2) 00000100:00100000:0.0:1769074924.417466:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:2418:x1855007616102272:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 592us (933us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074924.417475:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 170 00000100:00100000:1.0:1769074924.417721:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102144 00000100:00100000:1.0:1769074924.417729:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102144 00000100:00100000:1.0:1769074924.417789:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9429 00000100:00100000:1.0:1769074924.417797:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67431:x1855007616102144:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074924.417811:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.417826:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f0e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6ea expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.417870:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.417881:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417894:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417917:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.417924:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417930:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417963:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417969:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417975:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417980:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417985:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.417988:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.417993:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418001:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.418003:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.418007:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418012:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418023:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418029:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418034:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418037:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.418040:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418044:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418050:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff916052708f00) 00010000:00010000:1.0:1769074924.418052:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.418055:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418060:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.418082:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f0e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ea expref: 419 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.418090:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.418093:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.418096:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ea expref: 419 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.418116:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074924.418152:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67431:x1855007616102144:12345-192.168.204.32@tcp:101:rm.0 Request processed in 356us (1704us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.418159:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9429 00000100:00100000:3.0:1769074924.423921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.424010:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102400 00000100:00100000:0.0:1769074924.424024:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102400 00000100:00100000:0.0:1769074924.424101:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9430 00000100:00100000:0.0:1769074924.424114:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67431:x1855007616102400:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074924.424143:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.424179:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f23 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6f8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.424270:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.424287:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424299:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424314:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.424335:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424341:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424403:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424410:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424416:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424423:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.424427:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424435:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424447:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.424450:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.424456:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424461:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424477:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424482:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424487:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424839:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.424843:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424849:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424859:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff91604e0d3400) 00010000:00010000:0.0:1769074924.424862:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.424865:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424870:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f31 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.424911:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f23 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6f8 expref: 419 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.424922:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.424924:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.424928:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f23 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6f8 expref: 419 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.424936:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074924.425015:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67431:x1855007616102400:12345-192.168.204.32@tcp:101:rm.0 Request processed in 903us (1110us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.425024:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9430 00000100:00100000:2.0:1769074924.440117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.440238:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102528 00000100:00100000:0.0:1769074924.440253:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102528 00000100:00100000:0.0:1769074924.440339:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9431 00000100:00100000:0.0:1769074924.440351:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67432:x1855007616102528:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.440380:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.440407:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a6ff expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.440502:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.440519:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440570:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440586:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.440593:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440599:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440668:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440675:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440681:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440689:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.440694:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440702:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440716:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.440720:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.440726:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440731:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f3f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440745:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440751:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440756:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440761:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.440763:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440770:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440775:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff91604e0d3400) 00010000:00010000:0.0:1769074924.440778:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.440781:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440786:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f46 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.440823:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f38 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ff expref: 419 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.440834:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.440836:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.440840:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a6ff expref: 419 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.440849:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074924.440929:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67432:x1855007616102528:12345-192.168.204.32@tcp:101:cp.0 Request processed in 579us (825us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.440937:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9431 00000100:00100000:2.0:1769074924.444391:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.445137:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102656 00000100:00100000:1.0:1769074924.445154:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102656 00000100:00100000:1.0:1769074924.445245:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9432 00000100:00100000:1.0:1769074924.445256:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67432:x1855007616102656:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074924.445283:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.445312:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a706 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.445414:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.445433:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445448:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445468:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074924.445474:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445480:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445607:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445615:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445621:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445627:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445634:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.445639:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445647:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445661:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.445665:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.445671:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445677:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fe9f54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445695:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445701:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445706:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445711:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.445714:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445719:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445726:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff916052708f00) 00010000:00010000:1.0:1769074924.445728:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.445731:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445736:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fe9f5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074924.445770:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f4d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a706 expref: 419 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.445780:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.445782:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.445785:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fe9f4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a706 expref: 419 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.445805:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074924.445879:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67432:x1855007616102656:12345-192.168.204.32@tcp:101:cp.0 Request processed in 625us (1504us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074924.445887:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9432 00000100:00100000:3.0:1769074924.449588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.449726:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616102912 00000100:00100000:0.0:1769074924.449740:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616102912 00000100:00100000:0.0:1769074924.449816:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9433 00000100:00100000:0.0:1769074924.449828:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67432:x1855007616102912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.449857:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.449881:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f62 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a70d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.450032:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.450050:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450065:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450079:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.450084:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450089:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074924.450601:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb6:0x0], index 0: 0 00010000:00010000:0.0:1769074924.450796:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9f77 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x176:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.450808:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9f77 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450816:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9f77 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450860:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450868:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450875:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450881:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.450885:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450893:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450905:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.450908:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.450914:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450919:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fe9f69 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074924.450936:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003a6f80a3 reply state 000000007ac43989 transno 4294969034 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450947:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.450953:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff91604e0d3400) 00010000:00010000:0.0:1769074924.450955:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074924.450958:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074924.451000:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fe9f62 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a70d expref: 421 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.451016:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa800/0x557988ac98fe9f77 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a70d expref: 420 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.451023:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x176:0x0].0x0 (ffff91604e0d3800) 00010000:00010000:0.0:1769074924.451025:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074924.451028:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa800, rc 0) 00000100:00100000:0.0:1769074924.451118:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67432:x1855007616102912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1291us (1589us total) trans 4294969034 rc 0/0 00000100:00100000:0.0:1769074924.451131:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9433 00000100:00100000:2.0:1769074924.455870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.456137:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103040 00000100:00100000:3.0:1769074924.456154:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103040 00000100:00100000:3.0:1769074924.456241:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2721 00000100:00100000:3.0:1769074924.456253:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2420:x1855007616103040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.456280:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.456311:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a714 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074924.456353:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074924.456381:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.456384:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.456394:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 162 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.456414:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 162 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.456431:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074924.460790:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2420:x1855007616103040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4511us (4911us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.460809:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2721 00000100:00100000:2.0:1769074924.465235:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.465358:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103168 00000100:00100000:3.0:1769074924.465371:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103168 00000100:00100000:3.0:1769074924.465450:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2722 00000100:00100000:3.0:1769074924.465462:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:67432:x1855007616103168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.465488:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.465514:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a71b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.465786:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.465795:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.465798:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.465802:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a71b expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.465853:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.465870:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00000100:00100000:3.0:1769074924.465886:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049eb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626623360:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074924.466102:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074924.467779:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1769074924.467800:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626623488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074924.467883:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074924.467934:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626623488 00000100:00100000:1.0:1769074924.467943:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626623488 00000100:00100000:1.0:1769074924.468014:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1769074924.468024:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626623488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1769074924.468051:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484936640 pending 0 free 3764449280 avail 3532926976 00000100:00100000:1.0:1769074924.468102:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626623488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074924.468109:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1769074924.468175:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626623488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074924.476075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.476296:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626623360:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074924.476352:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a71b expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.476377:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7600, rc 0) 00000100:00100000:3.0:1769074924.476449:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:67432:x1855007616103168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10989us (11231us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.476459:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2722 00000100:00100000:2.0:1769074924.478218:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103296 00000100:00100000:2.0:1769074924.478239:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103296 00010000:00010000:2.0:1769074924.478405:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00000100:00100000:2.0:1769074924.478630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1888 00000100:00100000:2.0:1769074924.478645:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2420:x1855007616103296:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074924.478665:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074924.478694:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00010000:00010000:2.0:1769074924.478718:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00010000:00010000:2.0:1769074924.478749:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7800/0x557988ac98fe9f85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a714 expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00010000:00010000:2.0:1769074924.478768:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.478904:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.478917:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a71b expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.478931:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a71b expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.478990:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e2a7600/0x557988ac98fe9f8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a71b expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074924.479010:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d24a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626623616:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074924.479147:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074924.483040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.483123:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103552 00000100:00100000:0.0:1769074924.483135:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103552 00000100:00100000:0.0:1769074924.483217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1873 00000100:00100000:0.0:1769074924.483229:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67432:x1855007616103552:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074924.483653:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67432:x1855007616103552:12345-192.168.204.32@tcp:35:cp.0 Request processed in 425us (625us total) trans 4294969035 rc 0/0 00000100:00100000:0.0:1769074924.483663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1873 00000100:00100000:2.0:1769074924.488656:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d24a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626623616:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074924.488699:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074924.488986:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2420:x1855007616103296:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10341us (12923us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.489001:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1888 00000100:00100000:1.0:1769074924.524691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.524896:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103680 00000100:00100000:3.0:1769074924.524911:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103680 00000100:00100000:3.0:1769074924.524988:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9434 00000100:00100000:3.0:1769074924.524999:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67435:x1855007616103680:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074924.525025:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.525054:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9f93 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a722 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.525139:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074924.525158:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525204:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525224:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074924.525230:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525240:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525309:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525317:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525483:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525675:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525684:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.525689:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525697:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525712:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.525715:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.525721:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525727:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fe9f9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525744:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525749:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525756:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525761:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.525764:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525770:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525777:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff9161500d2700) 00010000:00010000:3.0:1769074924.525780:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.525783:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525789:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fa1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074924.525834:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9f93 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a722 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.525846:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.525848:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.525853:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9f93 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a722 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.525862:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ca00, rc 0) 00000100:00100000:2.0:1769074924.531904:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67435:x1855007616103680:12345-192.168.204.32@tcp:101:bash.0 Request processed in 6887us (7210us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074924.531923:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9434 00000100:00100000:0.0:1769074924.541912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.542112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.542213:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103936 00000100:00100000:2.0:1769074924.542229:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103936 00000100:00100000:2.0:1769074924.542303:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:2.0:1769074924.542315:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:2418:x1855007616103936:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074924.542402:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.542430:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9fa8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a730 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.542712:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074924.542732:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542747:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542765:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074924.542853:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542862:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542933:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542940:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542948:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542954:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.542959:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542967:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542982:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.542985:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.542991:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.542997:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fe9faf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543013:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543019:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543024:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543030:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.543033:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543039:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543051:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff91604f4f6200) 00010000:00010000:2.0:1769074924.543054:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.543057:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543062:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fe9fb6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.543098:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9fa8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a730 expref: 423 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.543109:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.543111:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074924.543115:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fe9fa8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a730 expref: 423 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.543124:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc -2) 00000100:00100000:2.0:1769074924.543214:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:2418:x1855007616103936:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 900us (1317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074924.543223:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:0.0:1769074924.546434:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616103808 00000100:00100000:0.0:1769074924.546460:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616103808 00000100:00100000:0.0:1769074924.546703:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9435 00000100:00100000:0.0:1769074924.546716:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67436:x1855007616103808:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074924.546743:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.546847:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fbd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a729 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.546945:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.546965:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.546977:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.546994:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.547006:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547013:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547085:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547093:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547098:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547105:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547112:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.547117:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547126:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547141:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.547145:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.547151:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547157:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9fc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547186:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547194:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547200:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547205:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.547208:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547214:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547221:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff91604e0d3e00) 00010000:00010000:0.0:1769074924.547224:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.547226:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547232:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fcb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.547268:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fbd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a729 expref: 423 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.547279:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.547281:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.547285:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a729 expref: 423 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.547295:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa000, rc 0) 00000100:00100000:0.0:1769074924.547403:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67436:x1855007616103808:12345-192.168.204.32@tcp:101:rm.0 Request processed in 690us (5291us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.547412:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9435 00000100:00100000:2.0:1769074924.550716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.550948:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104064 00000100:00100000:3.0:1769074924.550962:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104064 00000100:00100000:3.0:1769074924.551035:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9436 00000100:00100000:3.0:1769074924.551047:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67436:x1855007616104064:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074924.551075:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.551103:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fd2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a768 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.551209:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.551228:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551241:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551259:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.551266:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551272:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551354:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551362:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551369:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551376:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.551382:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551390:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551404:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.551408:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.551415:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551421:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fe9fd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551436:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551442:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551448:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551453:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.551457:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551463:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551469:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff9161500d2700) 00010000:00010000:3.0:1769074924.551472:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.551475:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551484:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fe9fe0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.551739:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fd2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a768 expref: 423 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.551751:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.551754:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.551758:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fe9fd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a768 expref: 423 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.551767:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074924.551935:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67436:x1855007616104064:12345-192.168.204.32@tcp:101:rm.0 Request processed in 888us (1231us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.551943:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9436 00000100:00100000:1.0:1769074924.568651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.568759:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104192 00000100:00100000:0.0:1769074924.568784:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104192 00000100:00100000:0.0:1769074924.568863:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9437 00000100:00100000:0.0:1769074924.568874:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67439:x1855007616104192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.568899:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.568926:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fe7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a76f expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.569009:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.569026:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569039:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569058:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.569066:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569072:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569142:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569149:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569155:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569173:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569180:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.569184:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569192:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569208:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.569212:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.569218:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569224:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fe9fee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569240:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569245:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569250:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569255:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.569257:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569267:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569274:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff91604e0d3e00) 00010000:00010000:0.0:1769074924.569277:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.569279:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569285:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fe9ff5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.569333:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fe7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a76f expref: 423 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.569344:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.569347:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.569351:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9fe7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a76f expref: 423 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.569360:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa000, rc 0) 00000100:00100000:0.0:1769074924.569445:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67439:x1855007616104192:12345-192.168.204.32@tcp:101:cp.0 Request processed in 570us (808us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.569454:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9437 00000100:00100000:1.0:1769074924.574462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.574744:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104320 00000100:00100000:0.0:1769074924.574758:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104320 00000100:00100000:0.0:1769074924.574844:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:0.0:1769074924.574856:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:2418:x1855007616104320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074924.574928:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.574955:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9ffc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a776 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.575037:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.575059:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575076:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575093:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074924.575100:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575107:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575203:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575212:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575220:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575227:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.575232:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575239:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575253:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.575257:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.575263:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575269:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea003 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575283:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575289:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575295:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575301:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.575303:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575309:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575316:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074924.575318:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.575321:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575326:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea00a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074924.575357:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9ffc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a776 expref: 423 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.575368:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.575371:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074924.575375:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fe9ffc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a776 expref: 423 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.575384:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa000, rc -2) 00000100:00100000:0.0:1769074924.575474:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:2418:x1855007616104320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 620us (1025us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074924.575483:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:2.0:1769074924.578316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.578422:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104448 00000100:00100000:3.0:1769074924.578437:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104448 00000100:00100000:3.0:1769074924.578523:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9438 00000100:00100000:3.0:1769074924.578572:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67439:x1855007616104448:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.578599:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.578627:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea011 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a7ae expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.578718:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.578737:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578755:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578785:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.578793:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578799:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578868:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578876:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578883:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578889:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.578894:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578903:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578915:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.578919:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.578925:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578930:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea018 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578946:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578951:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578956:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578960:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.578962:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578967:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578973:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff9161500d2700) 00010000:00010000:3.0:1769074924.578975:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.578978:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.578982:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea01f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.579017:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea011 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7ae expref: 423 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.579028:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.579030:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.579034:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea011 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7ae expref: 423 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.579048:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ca00, rc 0) 00000100:00100000:3.0:1769074924.579123:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67439:x1855007616104448:12345-192.168.204.32@tcp:101:cp.0 Request processed in 589us (820us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.579132:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9438 00000100:00100000:1.0:1769074924.584631:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.584794:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104704 00000100:00100000:0.0:1769074924.584809:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104704 00000100:00100000:0.0:1769074924.584885:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9439 00000100:00100000:0.0:1769074924.584896:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67439:x1855007616104704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.584923:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.584952:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fea026 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a7b5 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.585115:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.585133:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585147:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585178:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x739a153d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.585190:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585196:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074924.585637:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb7:0x0], index 1: 0 00010000:00010000:0.0:1769074924.585826:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fea03b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x177:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.585838:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fea03b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585846:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fea03b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585890:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585898:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585904:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585911:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585917:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.585923:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585930:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585945:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.585949:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.585954:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585961:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea02d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074924.585977:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004929905a reply state 000000008ccbe37e transno 4294969036 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585990:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.585996:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff91604e0d3e00) 00010000:00010000:0.0:1769074924.585998:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074924.586001:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074924.586036:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa000/0x557988ac98fea026 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7b5 expref: 425 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.586050:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb400/0x557988ac98fea03b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7b5 expref: 424 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.586057:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x177:0x0].0x0 (ffff91604e0d3f00) 00010000:00010000:0.0:1769074924.586059:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074924.586061:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb400, rc 0) 00000100:00100000:0.0:1769074924.586146:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67439:x1855007616104704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1253us (1530us total) trans 4294969036 rc 0/0 00000100:00100000:0.0:1769074924.586154:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9439 00000100:00100000:1.0:1769074924.590690:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.591009:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104832 00000100:00100000:3.0:1769074924.591021:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104832 00000100:00100000:3.0:1769074924.591094:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2723 00000100:00100000:3.0:1769074924.591105:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+160:2420:x1855007616104832:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074924.591130:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.591167:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a7bc expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074924.591195:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074924.591221:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.591224:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.591235:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 161 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.591256:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 161 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074924.591272:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074924.591359:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2420:x1855007616104832:12345-192.168.204.32@tcp:101:cp.0 Request processed in 255us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.591367:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2723 00000040:00080000:2.0:1769074924.597698:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1769074924.597711:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769074924.598248:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1769074924.598264:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1769074924.603680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.604224:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616104960 00000100:00100000:1.0:1769074924.604238:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616104960 00000100:00100000:0.0:1769074924.604863:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2724 00000100:00100000:0.0:1769074924.604881:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:67439:x1855007616104960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.604905:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.604929:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a7c3 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.604969:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 162 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.604978:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.604981:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.604986:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7c3 expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.605034:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 162 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.605051:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 162 pid: 25313 timeout: 2013 lvb_type: 1 00000100:00100000:0.0:1769074924.605068:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626623744:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074924.605255:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042a3d000 going to sleep for 11 seconds 00000100:00100000:0.0:1769074924.608958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.609051:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105088 00000100:00100000:3.0:1769074924.609065:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105088 00010000:00010000:3.0:1769074924.609146:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00000100:00100000:3.0:1769074924.609209:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1889 00000100:00100000:3.0:1769074924.609220:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616105088:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074924.609240:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074924.609269:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00010000:00010000:3.0:1769074924.609284:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00010000:00010000:3.0:1769074924.609317:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.609418:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.609429:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7c3 expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.609439:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7c3 expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.609487:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7c3 expref: 163 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074924.609674:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049eb6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626623872:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074924.610001:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1769074924.610170:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91617f988a00/0x557988ac98fea049 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7bc expref: 163 pid: 25313 timeout: 2013 lvb_type: 1 00000100:00100000:2.0:1769074924.610191:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626623744:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074924.610225:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa000/0x557988ac98fea050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7c3 expref: 162 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.610236:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa000, rc 0) 00000100:00100000:2.0:1769074924.610274:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:67439:x1855007616104960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5399us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.610283:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2724 00000100:00100000:0.0:1769074924.615023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074924.615117:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105344 00000100:00100000:1.0:1769074924.615131:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105344 00000100:00100000:1.0:1769074924.615248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1874 00000100:00100000:1.0:1769074924.615260:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67439:x1855007616105344:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074924.616055:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67439:x1855007616105344:12345-192.168.204.32@tcp:35:cp.0 Request processed in 793us (1043us total) trans 4294969037 rc 0/0 00000100:00100000:1.0:1769074924.616066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1874 00000100:00100000:3.0:1769074924.616174:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626623872:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074924.616208:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074924.616236:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2419:x1855007616105088:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7019us (7293us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.616245:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1889 00000100:00100000:2.0:1769074924.658224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.665936:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105472 00000100:00100000:3.0:1769074924.665960:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105472 00000100:00100000:2.0:1769074924.669097:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:2.0:1769074924.669118:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:2417:x1855007616105472:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074924.669215:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.669248:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea057 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a7ca expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.669346:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074924.669366:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669382:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669399:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074924.669412:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669419:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669506:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669515:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669521:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669527:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.669557:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669565:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669579:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.669582:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.669588:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669594:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea05e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669610:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669616:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669623:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669628:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.669630:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669636:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669643:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff91604f4f6200) 00010000:00010000:2.0:1769074924.669645:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.669648:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669654:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea065 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074924.669686:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea057 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7ca expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.669710:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.669712:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074924.669716:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea057 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a7ca expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.669725:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc -2) 00000100:00100000:2.0:1769074924.669843:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:2417:x1855007616105472:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 730us (11632us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074924.669853:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:0.0:1769074924.687387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.687558:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105600 00000100:00100000:3.0:1769074924.687572:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105600 00000100:00100000:3.0:1769074924.687651:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9440 00000100:00100000:3.0:1769074924.687663:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67447:x1855007616105600:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074924.687691:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.687720:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea06c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a802 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.687929:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.687947:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.687961:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.687979:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.687985:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.687991:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.688057:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.688065:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.688072:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.688078:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.688083:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689720:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689755:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.689759:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.689766:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689785:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea073 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689807:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689814:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689821:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689827:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.689831:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689837:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689844:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e24c000) 00010000:00010000:3.0:1769074924.689847:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.689850:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689855:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea07a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.689909:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea06c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a802 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.689919:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.689922:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.689925:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea06c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a802 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.689934:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f989800, rc 0) 00000100:00100000:3.0:1769074924.690297:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67447:x1855007616105600:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2633us (2925us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.690309:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9440 00000100:00100000:1.0:1769074924.700795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.701009:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105728 00000100:00100000:0.0:1769074924.701021:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105728 00000100:00100000:0.0:1769074924.701096:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9441 00000100:00100000:0.0:1769074924.701106:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67448:x1855007616105728:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074924.701134:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.701172:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea081 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a809 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.701260:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.701277:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701289:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701306:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.701313:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701332:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701399:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701406:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701415:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701420:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.701425:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701436:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701448:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.701451:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.701458:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701464:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea088 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701479:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701484:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701489:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701507:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.701509:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701515:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701523:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e0d3000) 00010000:00010000:0.0:1769074924.701525:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.701527:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701579:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea08f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.701618:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea081 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a809 expref: 427 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.701629:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.701631:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.701635:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea081 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a809 expref: 427 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.701644:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074924.701731:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67448:x1855007616105728:12345-192.168.204.32@tcp:101:rm.0 Request processed in 626us (949us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.701740:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9441 00000100:00100000:2.0:1769074924.707379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.707590:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105856 00000100:00100000:0.0:1769074924.707609:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105856 00000100:00100000:0.0:1769074924.707707:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:0.0:1769074924.707720:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:2418:x1855007616105856:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074924.707787:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.707813:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea096 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a810 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.707894:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074924.707912:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.707925:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.707946:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074924.707952:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.707959:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708030:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708038:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708046:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708052:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.708057:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708066:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708081:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.708084:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.708089:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708096:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea09d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708112:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708120:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708126:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708131:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.708134:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708140:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708146:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604e0d3000) 00010000:00010000:0.0:1769074924.708149:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.708151:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708169:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074924.708202:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea096 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a810 expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.708212:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.708215:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074924.708219:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea096 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a810 expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.708229:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc -2) 00000100:00100000:0.0:1769074924.708312:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:2418:x1855007616105856:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 594us (942us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074924.708509:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:0.0:1769074924.712520:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.713070:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616105984 00000100:00100000:2.0:1769074924.713085:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616105984 00000100:00100000:2.0:1769074924.713171:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9442 00000100:00100000:2.0:1769074924.713183:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67448:x1855007616105984:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074924.713212:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.713242:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0ab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a817 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.713349:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.713368:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713381:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713397:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.713403:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713409:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713475:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713482:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713890:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713899:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713905:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.713909:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713918:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713931:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.713934:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.713939:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713945:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713960:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713966:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713972:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713976:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.713978:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713983:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.713993:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604f4f6200) 00010000:00010000:2.0:1769074924.713996:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.713998:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.714003:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.714041:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a817 expref: 427 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.714052:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.714054:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.714057:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a817 expref: 427 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.714065:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc 0) 00000100:00100000:2.0:1769074924.714169:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67448:x1855007616105984:12345-192.168.204.32@tcp:101:rm.0 Request processed in 988us (1675us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074924.714180:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9442 00010000:00010000:2.0:1769074924.724188:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769074924.732703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.733102:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106112 00000100:00100000:0.0:1769074924.733115:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106112 00000100:00100000:0.0:1769074924.733206:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9443 00000100:00100000:0.0:1769074924.733218:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67449:x1855007616106112:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.733247:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.733276:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea0c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a81e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.733377:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.733395:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733408:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733424:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.733431:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733437:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733506:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733515:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733522:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733528:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.733578:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733587:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733602:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.733605:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.733612:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733618:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733635:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733641:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733647:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733652:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.733655:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733662:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733673:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e0d3000) 00010000:00010000:0.0:1769074924.733676:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.733678:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.733684:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.734020:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea0c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a81e expref: 427 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.734033:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.734037:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.734040:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea0c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a81e expref: 427 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.734051:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074924.734137:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67449:x1855007616106112:12345-192.168.204.32@tcp:101:cp.0 Request processed in 921us (1459us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.734147:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9443 00000100:00100000:3.0:1769074924.742336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.742463:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106240 00000100:00100000:2.0:1769074924.742477:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106240 00000100:00100000:2.0:1769074924.742595:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9444 00000100:00100000:2.0:1769074924.742606:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67449:x1855007616106240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074924.742635:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.742662:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a825 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.742756:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.742784:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742805:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742823:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.742830:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742837:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742903:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742911:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742916:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742922:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742928:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.742932:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742943:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742956:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.742959:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.742965:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742970:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f200/0x557988ac98fea0dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742984:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742990:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742995:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.742999:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.743002:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.743007:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.743012:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604f4f6200) 00010000:00010000:2.0:1769074924.743015:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.743017:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.743021:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea0e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.743055:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0d5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a825 expref: 427 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.743066:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.743068:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.743071:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea0d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a825 expref: 427 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.743080:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:2.0:1769074924.743154:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67449:x1855007616106240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 549us (834us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074924.743173:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9444 00000100:00100000:1.0:1769074924.747442:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.747596:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106496 00000100:00100000:0.0:1769074924.747610:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106496 00000100:00100000:0.0:1769074924.747683:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9445 00000100:00100000:0.0:1769074924.747706:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67449:x1855007616106496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.747735:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.747772:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea0ea lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a82c expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.747949:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.747968:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.747981:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.747996:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.748003:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748009:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074924.748416:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb7:0x0], index 0: 0 00010000:00010000:0.0:1769074924.748647:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fea0ff lrc: 3/1,0 mode: --/PR res: [0x240000403:0x178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074924.748658:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fea0ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748667:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fea0ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748708:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748716:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748728:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748734:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.748739:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748747:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748762:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.748765:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.748770:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748776:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea0f1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074924.748796:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000073a34424 reply state 000000009d0060f5 transno 4294969038 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748808:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.748815:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e0d3000) 00010000:00010000:0.0:1769074924.748818:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074924.748821:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074924.748862:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea0ea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a82c expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.748878:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed400/0x557988ac98fea0ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a82c expref: 428 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.748891:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x178:0x0].0x0 (ffff91604e0d3300) 00010000:00010000:0.0:1769074924.748894:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074924.748897:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed400, rc 0) 00000100:00100000:0.0:1769074924.748999:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67449:x1855007616106496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1306us (1571us total) trans 4294969038 rc 0/0 00000100:00100000:0.0:1769074924.749009:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9445 00000100:00100000:0.0:1769074924.755454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.755652:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106624 00000100:00100000:2.0:1769074924.755665:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106624 00000100:00100000:2.0:1769074924.756026:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2725 00000100:00100000:2.0:1769074924.756038:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2420:x1855007616106624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074924.756063:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.756092:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a833 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074924.756123:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074924.756150:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.756153:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.756173:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074924.756195:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074924.756210:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074924.756291:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2420:x1855007616106624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 254us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.756298:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2725 00000100:00100000:3.0:1769074924.762398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.762604:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106752 00000100:00100000:2.0:1769074924.762618:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106752 00000100:00100000:2.0:1769074924.762700:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2726 00000100:00100000:2.0:1769074924.762710:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:67449:x1855007616106752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074924.762733:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.762754:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a83a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.762806:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 164 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074924.762814:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.762817:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.762822:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a83a expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.762861:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 164 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074924.762876:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074924.762896:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626624000:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074924.763019:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47780 going to sleep for 11 seconds 00000100:00100000:1.0:1769074924.767176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.767397:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626624000:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074924.767444:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a83a expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.767469:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f200, rc 0) 00000100:00100000:3.0:1769074924.768020:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616106880 00000100:00100000:3.0:1769074924.768032:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616106880 00010000:00010000:3.0:1769074924.768104:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 165 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:3.0:1769074924.768174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1890 00000100:00100000:3.0:1769074924.768187:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:2419:x1855007616106880:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074924.768205:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074924.768234:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 165 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:3.0:1769074924.768250:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 165 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:3.0:1769074924.768280:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e71fc00/0x557988ac98fea10d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a833 expref: 165 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:3.0:1769074924.768298:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.768300:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074924.768309:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a83a expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.768320:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a83a expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.768365:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e71f200/0x557988ac98fea114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a83a expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074924.768382:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049eb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626624128:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074924.768620:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:67449:x1855007616106752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5908us (6237us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.768631:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2726 00000100:00100000:3.0:1769074924.769264:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074924.775392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.775577:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107136 00000100:00100000:2.0:1769074924.775591:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107136 00000100:00100000:2.0:1769074924.775661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1875 00000100:00100000:2.0:1769074924.775672:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67449:x1855007616107136:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074924.776103:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67449:x1855007616107136:12345-192.168.204.32@tcp:35:cp.0 Request processed in 431us (723us total) trans 4294969039 rc 0/0 00000100:00100000:2.0:1769074924.776111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1875 00000100:00100000:3.0:1769074924.779269:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626624128:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074924.779307:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074924.779724:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616106880:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 11535us (12568us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.779739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1890 00000100:00100000:0.0:1769074924.825917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.826087:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107264 00000100:00100000:2.0:1769074924.826101:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107264 00000100:00100000:2.0:1769074924.826182:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9446 00000100:00100000:2.0:1769074924.826194:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67452:x1855007616107264:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074924.826223:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074924.826253:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea11b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a841 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.826360:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.826378:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826392:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826409:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074924.826416:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826423:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826505:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826513:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826520:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826528:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826584:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.826590:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826598:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826611:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.826615:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.826620:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826627:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea122 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826642:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826649:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826654:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826659:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074924.826662:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826668:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826675:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604f4f6b00) 00010000:00010000:2.0:1769074924.826677:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.826680:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826690:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea129 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074924.826727:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea11b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a841 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.826737:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074924.826740:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074924.826744:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea11b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a841 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.826753:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074924.827129:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67452:x1855007616107264:12345-192.168.204.32@tcp:101:bash.0 Request processed in 934us (1224us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074924.827140:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9446 00000100:00100000:0.0:1769074924.857674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.857736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.857996:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107392 00000100:00100000:3.0:1769074924.858011:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107392 00000100:00100000:3.0:1769074924.858087:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9447 00000100:00100000:3.0:1769074924.858099:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67453:x1855007616107392:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074924.858135:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074924.858173:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea130 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a848 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.858258:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.858277:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858291:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858310:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074924.858329:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858336:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858409:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858417:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858425:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858431:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.858436:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858444:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858459:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.858463:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.858469:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858475:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ce00/0x557988ac98fea137 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858489:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858495:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858501:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858506:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074924.858509:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858516:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858527:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e24c000) 00010000:00010000:3.0:1769074924.858572:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.858576:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858581:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea13e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074924.858619:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea130 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a848 expref: 431 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.858630:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074924.858633:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074924.858636:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea130 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a848 expref: 431 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.858645:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ca00, rc 0) 00000100:00100000:3.0:1769074924.858737:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67453:x1855007616107392:12345-192.168.204.32@tcp:101:rm.0 Request processed in 639us (1078us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074924.858746:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9447 00000100:00100000:1.0:1769074924.859824:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107520 00000100:00100000:1.0:1769074924.859838:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107520 00000100:00100000:1.0:1769074924.859896:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 175 00000100:00100000:1.0:1769074924.859905:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:2417:x1855007616107520:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074924.859943:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074924.859962:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea145 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a84f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.860019:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074924.860034:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860045:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860061:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074924.860068:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860074:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860133:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860145:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860151:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860167:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.860172:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860180:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860192:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.860196:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.860199:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860204:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea14c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860229:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860235:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860241:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860246:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074924.860249:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860259:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860265:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052708f00) 00010000:00010000:1.0:1769074924.860268:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074924.860270:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860276:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea153 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074924.860305:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea145 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a84f expref: 431 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.860314:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074924.860328:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074924.860333:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea145 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a84f expref: 431 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074924.860343:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc -2) 00000100:00100000:1.0:1769074924.870242:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:2417:x1855007616107520:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 10319us (12486us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074924.870263:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 175 00000100:00100000:2.0:1769074924.874164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.875488:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107648 00000100:00100000:0.0:1769074924.875520:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107648 00000100:00100000:0.0:1769074924.875658:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9448 00000100:00100000:0.0:1769074924.875669:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67453:x1855007616107648:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074924.875707:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.875740:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea15a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a856 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.876348:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.876369:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876383:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876406:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.876412:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876418:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876505:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876512:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876517:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876524:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876556:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.876561:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876570:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876585:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.876589:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.876595:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876602:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea161 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876619:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876626:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876631:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876636:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.876639:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876644:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876650:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3500) 00010000:00010000:0.0:1769074924.876653:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.876656:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876661:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea168 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.876715:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea15a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a856 expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.876726:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.876729:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.876733:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea15a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a856 expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.876749:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074924.877875:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67453:x1855007616107648:12345-192.168.204.32@tcp:101:rm.0 Request processed in 2197us (3730us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.877888:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9448 00000100:00100000:0.0:1769074924.917636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.918640:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107776 00000100:00100000:2.0:1769074924.918661:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107776 00000100:00100000:0.0:1769074924.919126:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9449 00000100:00100000:0.0:1769074924.919140:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67454:x1855007616107776:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.919180:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.919211:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea16f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a85d expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.919312:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.919341:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919355:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919372:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.919379:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919386:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919456:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919465:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919471:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919478:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919485:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.919503:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919512:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919526:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.919704:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.919712:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919719:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98fea176 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919740:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919749:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919754:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919760:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.919916:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919925:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919936:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3500) 00010000:00010000:0.0:1769074924.919939:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.919943:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.919948:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fea17d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.920091:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea16f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a85d expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.920104:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.920107:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.920111:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98fea16f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a85d expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.920123:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074924.920231:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67454:x1855007616107776:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1093us (2608us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.920241:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9449 00000100:00100000:3.0:1769074924.923455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.923654:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616107904 00000100:00100000:0.0:1769074924.923667:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616107904 00000100:00100000:0.0:1769074924.923943:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9450 00000100:00100000:0.0:1769074924.923957:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67454:x1855007616107904:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.924123:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.924164:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea184 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a864 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.924260:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.924279:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924291:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924348:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.924357:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924363:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924434:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924442:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924449:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924456:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924462:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.924468:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924477:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924493:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.924496:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.924503:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924510:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fea18b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924566:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924573:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924579:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924584:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.924588:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924594:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924601:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3900) 00010000:00010000:0.0:1769074924.924604:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.924606:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924615:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea192 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.924655:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea184 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a864 expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.924666:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.924669:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.924672:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fea184 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a864 expref: 431 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.924683:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074924.925210:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67454:x1855007616107904:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1253us (1765us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074924.925220:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9450 00000100:00100000:2.0:1769074924.933371:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.933639:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108160 00000100:00100000:0.0:1769074924.933654:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108160 00000100:00100000:0.0:1769074924.933745:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9451 00000100:00100000:0.0:1769074924.933758:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67454:x1855007616108160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.933786:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.933817:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea199 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a86b expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.934172:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.934192:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.934210:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.934229:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.934236:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.934242:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074924.935079:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb8:0x0], index 1: 0 00010000:00010000:0.0:1769074924.935398:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48600/0x557988ac98fea1ae lrc: 3/1,0 mode: --/PR res: [0x240000403:0x179:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074924.935413:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48600/0x557988ac98fea1ae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935424:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48600/0x557988ac98fea1ae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935469:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935477:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935484:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935492:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935504:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.935509:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935518:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935571:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074924.935576:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.935582:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935589:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1a0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074924.935609:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fbacf117 reply state 00000000dc661ae3 transno 4294969040 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935622:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.935629:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3500) 00010000:00010000:0.0:1769074924.935632:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074924.935635:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074924.935694:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea199 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a86b expref: 433 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.935712:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48600/0x557988ac98fea1ae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a86b expref: 432 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.935719:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x179:0x0].0x0 (ffff91604e0d3600) 00010000:00010000:0.0:1769074924.935722:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074924.935725:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48600, rc 0) 00000100:00100000:0.0:1769074924.935821:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67454:x1855007616108160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2065us (2465us total) trans 4294969040 rc 0/0 00000100:00100000:0.0:1769074924.935832:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9451 00000100:00100000:3.0:1769074924.941226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.941478:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108288 00000100:00100000:0.0:1769074924.941492:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108288 00000100:00100000:0.0:1769074924.941602:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2727 00000100:00100000:0.0:1769074924.941615:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+161:2420:x1855007616108288:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.941641:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.941690:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a872 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074924.941722:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074924.941749:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.941752:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.941763:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 162 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.941797:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 162 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.941813:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074924.941888:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2420:x1855007616108288:12345-192.168.204.32@tcp:101:cp.0 Request processed in 275us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074924.941896:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2727 00000100:00100000:3.0:1769074924.951005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074924.951325:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108416 00000100:00100000:0.0:1769074924.951339:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108416 00000100:00100000:0.0:1769074924.951406:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2728 00000100:00100000:0.0:1769074924.951417:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:67454:x1855007616108416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074924.951441:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074924.951464:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a879 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.951502:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.951512:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.951514:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074924.951519:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a879 expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074924.951581:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074924.951598:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:0.0:1769074924.951616:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626624256:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074924.951751:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384900 going to sleep for 11 seconds 00000001:00080000:2.0:1769074924.955130:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294969040 is committed 00010000:00010000:0.0:1769074924.955475:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955489:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955502:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955509:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.955514:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955524:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955567:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde0b2b0f (ffff916052b4c900) 00010000:00010000:0.0:1769074924.955570:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.955577:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955583:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fe873d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xde0b2b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955619:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955625:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955630:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955636:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.955639:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955644:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955653:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x52db4fc2 (ffff916052b4c700) 00010000:00010000:0.0:1769074924.955655:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.955658:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955664:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fe8801 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x52db4fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.955697:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955704:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955709:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955714:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.955716:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955722:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955731:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x24894c5e (ffff91604e0be200) 00010000:00010000:0.0:1769074924.955733:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.955735:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955740:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a400/0x557988ac98fe88b0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x24894c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955755:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955762:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955909:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955914:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.955918:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.955924:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956071:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2df5f5d1 (ffff91604e0bea00) 00010000:00010000:0.0:1769074924.956074:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956078:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956085:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fe895f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2df5f5d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956103:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956109:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956115:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956120:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956123:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956129:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956136:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb8d8446 (ffff91604ea4d500) 00010000:00010000:0.0:1769074924.956139:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956141:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956147:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98fe8a0e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xcb8d8446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074924.956187:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956194:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956199:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956205:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956208:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956214:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956221:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa887316a (ffff916052b4cf00) 00010000:00010000:0.0:1769074924.956224:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956227:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956233:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fe8ae7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa887316a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.956249:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956254:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956259:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956265:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956268:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956273:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956281:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa0cad3d5 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074924.956283:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956286:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956292:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98fe8bc0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa0cad3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074924.956306:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956312:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956329:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956337:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956340:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956346:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956355:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9392a964 (ffff91604f4dfd00) 00010000:00010000:0.0:1769074924.956357:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956360:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956366:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fe8c99 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9392a964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956382:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956388:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956393:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956398:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956400:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956406:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956412:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3427451a (ffff91604ec78b00) 00010000:00010000:0.0:1769074924.956415:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956418:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956423:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fe8d5d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3427451a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956435:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956441:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956446:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956451:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956454:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956459:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956465:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1d6432b6 (ffff91604f4df900) 00010000:00010000:0.0:1769074924.956467:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956469:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956474:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fe8e21 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1d6432b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956485:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956490:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956496:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956501:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956504:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956509:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956515:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95382be7 (ffff91604f4df700) 00010000:00010000:0.0:1769074924.956517:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956519:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956524:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98fe8ed0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x95382be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956566:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956572:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956577:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956581:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956583:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956589:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956597:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac9be172 (ffff91604f3d4c00) 00010000:00010000:0.0:1769074924.956599:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956602:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956607:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fe8f94 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xac9be172 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956620:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956625:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956631:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956636:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956639:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956644:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956650:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xea63b32a (ffff91604f3c6500) 00010000:00010000:0.0:1769074924.956651:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956654:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956659:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98fe9043 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xea63b32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956670:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956677:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956683:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956697:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956700:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956705:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956712:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d14cc8a (ffff91604f3c6100) 00010000:00010000:0.0:1769074924.956714:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956716:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956721:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fe90f2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7d14cc8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956734:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956740:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956746:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956750:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956753:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956759:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956766:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x993ede26 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074924.956768:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956770:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956775:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98fe91a1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x993ede26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956785:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956790:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956796:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956800:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956802:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956808:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956814:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71c26934 (ffff91604f3d4300) 00010000:00010000:0.0:1769074924.956817:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956820:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956825:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fe9250 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x71c26934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956842:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956848:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956854:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956858:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956861:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956866:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956873:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x53d05e86 (ffff91604f4df000) 00010000:00010000:0.0:1769074924.956875:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956877:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956882:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fe92ff lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x53d05e86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.956893:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956899:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956905:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956914:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956917:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956922:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956928:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xac5d7f5a (ffff91604f4dfb00) 00010000:00010000:0.0:1769074924.956930:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.956933:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956937:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fe93d8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xac5d7f5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.956948:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.956953:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.956958:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.956963:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916042d43800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.956965:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.956970:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00000100:00100000:1.0:1769074924.958883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074924.959214:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626624256:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074924.959263:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a879 expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074924.959289:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48800, rc 0) 00000100:00100000:3.0:1769074924.959374:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:67454:x1855007616108416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7958us (8383us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074924.959385:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2728 00000100:00100000:2.0:1769074924.959561:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108544 00000100:00100000:2.0:1769074924.959571:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108544 00010000:00010000:2.0:1769074924.959632:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074924.959672:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1891 00000100:00100000:2.0:1769074924.959874:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616108544:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074924.959897:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074924.959924:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074924.959939:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074924.959967:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916174a49e00/0x557988ac98fea1bc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a872 expref: 163 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:0.0:1769074924.960103:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd59841f8 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074924.960107:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960114:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960123:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98fe949c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd59841f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960162:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960170:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960177:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960183:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960186:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960194:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960201:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x38de1686 (ffff91604f3d4d00) 00010000:00010000:0.0:1769074924.960204:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960207:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960213:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fe9560 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x38de1686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960227:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960232:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960239:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960244:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960247:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960252:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960258:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa790c23e (ffff91604f4df800) 00010000:00010000:0.0:1769074924.960260:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960263:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960268:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fe960f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa790c23e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.960281:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960286:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960291:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960296:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960298:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960304:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960311:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8acc9fab (ffff91604f4df400) 00010000:00010000:0.0:1769074924.960313:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960316:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960321:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fe96d3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8acc9fab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960333:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960338:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960344:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960348:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960351:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960356:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960362:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2c6c0a (ffff916052af8500) 00010000:00010000:0.0:1769074924.960364:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960366:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960371:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fe9797 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4a2c6c0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960384:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960391:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960397:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960401:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960404:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960409:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960415:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x18290d53 (ffff91604f185900) 00010000:00010000:0.0:1769074924.960417:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960419:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960424:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fe985b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x18290d53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960436:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960441:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960445:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960450:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960452:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960459:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960465:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x19be9a18 (ffff916052af8400) 00010000:00010000:0.0:1769074924.960467:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960469:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960474:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fe991f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x19be9a18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960485:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960490:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960495:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960499:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960502:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960507:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960513:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x47b5a9f9 (ffff91604f15f100) 00010000:00010000:0.0:1769074924.960515:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960517:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960522:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fe99ce lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x47b5a9f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.960557:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960563:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960569:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960574:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960577:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960581:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960588:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2b52e617 (ffff91604f8b3000) 00010000:00010000:0.0:1769074924.960590:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960592:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960596:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98fe9a7d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2b52e617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960609:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960615:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960620:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960629:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.960631:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960636:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960644:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7b0203cc (ffff91604f4df200) 00010000:00010000:0.0:1769074924.960646:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.960649:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960654:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fe9b2c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7b0203cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.960668:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.960674:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074924.960848:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.960850:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074924.960861:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a879 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.960872:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a879 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074924.960918:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916174a48800/0x557988ac98fea1c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a879 expref: 162 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074924.960934:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626624384:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074924.961114:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47300 going to sleep for 11 seconds 00010000:00010000:0.0:1769074924.965231:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965240:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965246:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965259:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965283:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4f389932 (ffff91604e0d3d00) 00010000:00010000:0.0:1769074924.965287:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965294:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965303:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fe9bdb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4f389932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965350:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965358:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965363:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965368:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965371:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965376:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965384:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x85878570 (ffff91604e0d3100) 00010000:00010000:0.0:1769074924.965387:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965390:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965395:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98fe9c8a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x85878570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:0.0:1769074924.965409:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965417:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965424:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965429:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965432:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965437:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965444:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x29c212c0 (ffff91604f4f6a00) 00010000:00010000:0.0:1769074924.965447:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965450:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965455:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fe9d39 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x29c212c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074924.965469:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965474:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965479:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965484:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965486:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965492:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965500:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc54d5ff9 (ffff91604f42ab00) 00010000:00010000:0.0:1769074924.965502:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965505:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965510:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98fe9de8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc54d5ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965569:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965576:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965582:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965586:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965589:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965595:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965601:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6697a92c (ffff916174a68a00) 00010000:00010000:0.0:1769074924.965603:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965606:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965611:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fe9eac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6697a92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965624:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965630:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965636:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965641:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965644:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965649:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965656:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xee4ef69d (ffff91604e0d3400) 00010000:00010000:0.0:1769074924.965659:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965662:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965667:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fe9f70 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xee4ef69d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965681:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965687:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965693:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965697:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965700:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965707:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965714:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x739a153d (ffff91604e0d3e00) 00010000:00010000:0.0:1769074924.965716:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965718:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965723:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fea034 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x739a153d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965735:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965740:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965744:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965749:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965751:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965757:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965765:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdb4130f0 (ffff91604e0d3000) 00010000:00010000:0.0:1769074924.965767:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965770:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965776:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98fea0f8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdb4130f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074924.965791:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965797:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965803:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965808:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074924.965811:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965816:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965823:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xde8c6956 (ffff91604e0d3500) 00010000:00010000:0.0:1769074924.965825:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074924.965827:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074924.965833:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1a7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xde8c6956 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000100:00100000:3.0:1769074924.969994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074924.970472:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626624384:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074924.970509:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074924.970604:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2419:x1855007616108544:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10734us (11735us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074924.970622:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1891 00000100:00100000:1.0:1769074924.971808:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108800 00000100:00100000:1.0:1769074924.971823:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108800 00000100:00100000:1.0:1769074924.971888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1876 00000100:00100000:1.0:1769074924.971897:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+320:67454:x1855007616108800:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074924.972473:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67454:x1855007616108800:12345-192.168.204.32@tcp:35:cp.0 Request processed in 574us (2492us total) trans 4294969041 rc 0/0 00000100:00100000:1.0:1769074924.972482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1876 00000100:00100000:3.0:1769074925.041421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.041563:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616108928 00000100:00100000:1.0:1769074925.041578:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616108928 00000100:00100000:1.0:1769074925.041679:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 176 00000100:00100000:1.0:1769074925.041692:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2418:x1855007616108928:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074925.041751:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.041778:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea1ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a880 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.041856:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.041876:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.041891:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.041909:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.041917:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.041923:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042133:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042148:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042184:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042191:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.042196:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042205:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042220:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.042224:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.042230:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042236:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea1d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042253:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042260:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042265:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042270:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.042273:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042284:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042291:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052708f00) 00010000:00010000:1.0:1769074925.042293:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.042296:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042302:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea1d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.042347:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea1ca lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a880 expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.042357:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.042359:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074925.042363:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea1ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a880 expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.042374:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44800, rc -2) 00000100:00100000:1.0:1769074925.042477:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2418:x1855007616108928:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 787us (1073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074925.042489:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 176 00000100:00080000:2.0:1769074925.043226:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074925.051133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.051351:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109056 00000100:00100000:0.0:1769074925.051365:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109056 00000100:00100000:0.0:1769074925.051472:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9452 00000100:00100000:0.0:1769074925.051485:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67457:x1855007616109056:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074925.051513:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.051580:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a887 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.051671:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.051689:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051701:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051717:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.051724:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051731:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051797:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051805:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051811:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051818:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051824:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.051829:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051842:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051856:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.051860:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.051865:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051872:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea1e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051887:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051893:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051899:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051905:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.051907:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051913:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051920:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916174963d00) 00010000:00010000:0.0:1769074925.051922:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.051925:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051931:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea1ed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.051967:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1df lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a887 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.051992:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.051995:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.052000:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea1df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a887 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.052010:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074925.052088:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67457:x1855007616109056:12345-192.168.204.32@tcp:101:bash.0 Request processed in 606us (983us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.052097:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9452 00000100:00080000:2.0:1769074925.052712:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074925.063984:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.064046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.064182:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109312 00000100:00100000:2.0:1769074925.064196:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109312 00000100:00100000:2.0:1769074925.064274:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 177 00000100:00100000:2.0:1769074925.064285:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2420:x1855007616109312:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074925.064356:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.064383:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea1f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a895 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.064458:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.064477:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064490:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064506:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.064512:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064518:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064624:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064638:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064646:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064653:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.064658:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064666:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064680:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.064684:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.064689:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064696:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea1fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064709:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064716:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064722:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064727:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.064730:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064740:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064746:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.064749:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.064752:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064758:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea202 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.064790:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea1f4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a895 expref: 322 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.064800:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.064803:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074925.064806:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea1f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a895 expref: 322 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.064816:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc -2) 00000100:00100000:2.0:1769074925.064903:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2420:x1855007616109312:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 618us (854us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074925.064913:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 177 00000100:00100000:0.0:1769074925.065496:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109184 00000100:00100000:0.0:1769074925.065507:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109184 00000100:00100000:0.0:1769074925.065586:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9453 00000100:00100000:0.0:1769074925.065596:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67458:x1855007616109184:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074925.065612:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.065630:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea209 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a88e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.065684:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.065698:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065708:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065727:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.065734:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065740:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065782:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065789:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065795:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065800:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.065804:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065810:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065821:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.065824:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.065828:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065832:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea210 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065844:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065851:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065856:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065861:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.065864:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065870:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065876:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916174963d00) 00010000:00010000:0.0:1769074925.065878:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.065881:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065886:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea217 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.065914:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea209 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a88e expref: 322 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.065922:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.065924:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.065928:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea209 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a88e expref: 322 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.065936:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074925.066861:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67458:x1855007616109184:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1258us (2893us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.066874:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9453 00000100:00100000:2.0:1769074925.074958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.075053:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109440 00000100:00100000:0.0:1769074925.075068:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109440 00000100:00100000:0.0:1769074925.075141:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9454 00000100:00100000:0.0:1769074925.075163:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67458:x1855007616109440:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074925.075190:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.075218:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea21e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a8cd expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.075313:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.075331:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075344:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075359:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.075366:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075371:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075435:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075443:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075450:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075456:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.075461:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075469:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075482:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.075485:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.075490:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075496:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea225 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075510:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075516:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075522:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075526:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.075566:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075572:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075584:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916174963100) 00010000:00010000:0.0:1769074925.075586:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.075589:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075594:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea22c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.075626:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea21e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8cd expref: 322 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.075638:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.075640:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.075644:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea21e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8cd expref: 322 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.075652:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49600, rc 0) 00000100:00100000:0.0:1769074925.075721:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67458:x1855007616109440:12345-192.168.204.32@tcp:101:rm.0 Request processed in 571us (777us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.075729:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9454 00000100:00100000:2.0:1769074925.094369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.094470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.094571:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109696 00000100:00100000:1.0:1769074925.094585:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109696 00000100:00100000:1.0:1769074925.094661:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 178 00000100:00100000:1.0:1769074925.094673:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2419:x1855007616109696:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074925.094753:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.094780:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea233 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a8db expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.094873:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.094892:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.094906:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.094923:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.094930:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.094938:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095006:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095014:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095021:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095027:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.095031:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095043:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095057:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.095061:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.095066:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095072:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea23a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095094:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095099:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095105:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095109:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.095112:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095117:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095123:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff916052708f00) 00010000:00010000:1.0:1769074925.095125:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.095128:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095132:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea241 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.095176:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea233 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8db expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.095186:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.095188:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074925.095191:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea233 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8db expref: 322 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.095201:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45400, rc -2) 00000100:00100000:1.0:1769074925.095292:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:2419:x1855007616109696:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 621us (820us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074925.095301:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 178 00000100:00100000:0.0:1769074925.099614:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109568 00000100:00100000:0.0:1769074925.099639:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109568 00000100:00100000:0.0:1769074925.099740:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9455 00000100:00100000:0.0:1769074925.099753:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67461:x1855007616109568:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.099781:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.099810:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea248 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a8d4 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.099910:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.099929:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.099944:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.099960:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.099967:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.099973:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100040:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100048:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100053:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100060:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100066:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.100071:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100082:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100097:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.100100:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.100105:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100122:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea24f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100139:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100145:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100159:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100165:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.100168:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100174:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100181:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916174963100) 00010000:00010000:0.0:1769074925.100184:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.100186:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100192:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea256 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.100229:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea248 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8d4 expref: 322 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.100240:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.100242:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.100246:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea248 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a8d4 expref: 322 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.100256:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49600, rc 0) 00000100:00100000:0.0:1769074925.100728:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67461:x1855007616109568:12345-192.168.204.32@tcp:101:cp.0 Request processed in 975us (6373us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.100738:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9455 00000100:00100000:3.0:1769074925.109447:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.110050:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616109824 00000100:00100000:0.0:1769074925.110065:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616109824 00000100:00100000:0.0:1769074925.112580:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9456 00000100:00100000:0.0:1769074925.112614:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67461:x1855007616109824:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.112646:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.112677:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea25d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a913 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.112777:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.112795:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112808:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112829:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.112837:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112843:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112913:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112921:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112928:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112934:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112941:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.112945:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112954:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112970:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.112973:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.112979:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.112986:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea264 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113003:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113008:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113013:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113018:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.113021:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113026:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113032:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916174963d00) 00010000:00010000:0.0:1769074925.113035:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.113037:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113042:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48c00/0x557988ac98fea26b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.113076:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea25d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a913 expref: 322 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.113085:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.113087:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.113091:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea25d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a913 expref: 322 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.113103:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:1.0:1769074925.114624:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67461:x1855007616109824:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2013us (5178us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074925.114639:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9456 00000100:00100000:2.0:1769074925.126665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.126819:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110080 00000100:00100000:1.0:1769074925.126835:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110080 00000100:00100000:1.0:1769074925.126907:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9457 00000100:00100000:1.0:1769074925.126918:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+321:67461:x1855007616110080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.126948:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.126975:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea272 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a91a expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.127133:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.127160:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127176:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127192:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x4471f797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.127199:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127206:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:1.0:1769074925.127739:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb8:0x0], index 0: 0 00010000:00010000:1.0:1769074925.127928:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea287 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.127938:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea287 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127946:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea287 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127984:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127992:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.127999:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128005:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128016:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.128020:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128029:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128042:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.128045:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.128049:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128055:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44400/0x557988ac98fea279 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:1.0:1769074925.128081:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000048a0bd15 reply state 000000007961e447 transno 4294969042 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128092:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.128098:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916052708f00) 00010000:00010000:1.0:1769074925.128100:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074925.128102:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074925.128413:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea272 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a91a expref: 324 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.128431:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44a00/0x557988ac98fea287 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a91a expref: 323 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.128439:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17a:0x0].0x0 (ffff916052708000) 00010000:00010000:1.0:1769074925.128442:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074925.128446:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44a00, rc 0) 00000100:00100000:1.0:1769074925.128744:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67461:x1855007616110080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1825us (2091us total) trans 4294969042 rc 0/0 00000100:00100000:1.0:1769074925.128753:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9457 00000100:00100000:3.0:1769074925.148389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.150274:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110208 00000100:00100000:0.0:1769074925.150294:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110208 00000100:00100000:0.0:1769074925.150407:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2729 00000100:00100000:0.0:1769074925.150423:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2420:x1855007616110208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.150450:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.150479:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a921 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074925.150511:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074925.150589:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.150592:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.150603:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 164 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.150622:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 164 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.150638:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074925.150727:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2420:x1855007616110208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 308us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074925.150736:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2729 00000100:00080000:2.0:1769074925.150835:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074925.159011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.159124:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110336 00000100:00100000:0.0:1769074925.159138:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110336 00000100:00100000:0.0:1769074925.159228:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2730 00000100:00100000:0.0:1769074925.159240:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:67461:x1855007616110336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.159267:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.159291:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a928 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.159330:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.159336:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.159338:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.159342:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a928 expref: 165 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.159378:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.159400:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 2014 lvb_type: 1 00000100:00100000:0.0:1769074925.159416:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626624512:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074925.159739:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074925.164415:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626624512:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074925.164473:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a928 expref: 165 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.164497:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48c00, rc 0) 00000100:00100000:0.0:1769074925.164616:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:67461:x1855007616110336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5377us (5615us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074925.164628:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2730 00000100:00100000:1.0:1769074925.173214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.180504:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110464 00000100:00100000:2.0:1769074925.180545:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110464 00010000:00010000:2.0:1769074925.180641:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074925.180701:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1892 00000100:00100000:2.0:1769074925.180712:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:2419:x1855007616110464:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074925.180732:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074925.180761:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.180779:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.180811:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916174a48a00/0x557988ac98fea295 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a921 expref: 165 pid: 25313 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.180831:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.180833:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.180842:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a928 expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.180853:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a928 expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.180904:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48c00/0x557988ac98fea29c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a928 expref: 164 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074925.180922:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d26d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626624640:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074925.181052:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47300 going to sleep for 11 seconds 00000100:00100000:2.0:1769074925.189675:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d26d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626624640:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074925.189716:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074925.189810:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2419:x1855007616110464:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9098us (16610us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.189825:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1892 00000100:00100000:1.0:1769074925.198818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.198977:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110720 00000100:00100000:2.0:1769074925.198993:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110720 00000100:00100000:2.0:1769074925.199068:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1877 00000100:00100000:2.0:1769074925.199081:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+324:67461:x1855007616110720:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074925.200009:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67461:x1855007616110720:12345-192.168.204.32@tcp:35:cp.0 Request processed in 924us (1213us total) trans 4294969043 rc 0/0 00000100:00100000:2.0:1769074925.200022:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1877 00000100:00100000:1.0:1769074925.249694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.249890:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110848 00000100:00100000:2.0:1769074925.249905:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110848 00000100:00100000:2.0:1769074925.249981:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 179 00000100:00100000:2.0:1769074925.249992:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2417:x1855007616110848:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074925.250067:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.250093:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea2a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a92f expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.250185:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.250204:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250216:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250234:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.250241:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250247:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250325:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250333:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250340:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250346:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.250350:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250359:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250375:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.250378:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.250384:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250390:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea2aa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250405:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250410:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250416:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250421:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.250423:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250428:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250435:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.250438:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.250440:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250446:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea2b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.250479:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea2a3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a92f expref: 326 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.250490:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.250493:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074925.250497:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea2a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a92f expref: 326 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.250507:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc -2) 00000100:00100000:2.0:1769074925.250935:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2417:x1855007616110848:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 943us (1255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074925.250947:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 179 00000100:00100000:2.0:1769074925.277289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.277918:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616110976 00000100:00100000:1.0:1769074925.277934:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616110976 00000100:00100000:1.0:1769074925.278019:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9458 00000100:00100000:1.0:1769074925.278032:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67468:x1855007616110976:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074925.278057:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.278124:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a967 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.278263:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.278282:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278295:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278323:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.278331:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278338:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278435:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278444:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278469:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278476:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278482:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.278487:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278506:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.278998:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.279003:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.279009:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279033:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279061:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279067:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279084:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279090:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.279093:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279099:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279231:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916052708300) 00010000:00010000:1.0:1769074925.279235:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.279239:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.279257:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2c6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.280357:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2b8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a967 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.280376:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.280380:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.280385:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a967 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.280410:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074925.280515:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67468:x1855007616110976:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2485us (3240us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074925.280525:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9458 00000100:00100000:2.0:1769074925.294715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.294856:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111104 00000100:00100000:1.0:1769074925.294870:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111104 00000100:00100000:1.0:1769074925.294950:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9459 00000100:00100000:1.0:1769074925.294962:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67469:x1855007616111104:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074925.294992:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.295018:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a96e expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.295123:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.295142:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295166:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295184:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.295192:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295199:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295268:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295276:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295282:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295294:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295300:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.295305:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295314:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295329:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.295334:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.295340:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295345:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea2d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295363:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295369:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295374:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295379:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.295382:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295387:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295399:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916052708300) 00010000:00010000:1.0:1769074925.295401:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.295404:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295409:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea2db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.295445:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2cd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a96e expref: 326 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.295456:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.295459:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.295462:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea2cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a96e expref: 326 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.295482:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074925.295635:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67469:x1855007616111104:12345-192.168.204.32@tcp:101:rm.0 Request processed in 674us (933us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074925.295644:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9459 00000100:00100000:3.0:1769074925.300024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.300484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.300692:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111360 00000100:00100000:0.0:1769074925.300707:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111360 00000100:00100000:0.0:1769074925.300782:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9460 00000100:00100000:0.0:1769074925.300794:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67469:x1855007616111360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074925.300824:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.300851:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea2e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a97c expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.300933:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.300952:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.300966:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.300982:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.300989:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.300996:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301061:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301069:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301076:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301083:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.301088:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301096:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301109:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.301113:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.301120:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301127:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea2e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301141:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301158:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301165:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301170:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.301173:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301180:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301192:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916174963700) 00010000:00010000:0.0:1769074925.301195:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.301198:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301203:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea2f0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.301240:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea2e2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a97c expref: 326 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.301252:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.301255:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.301259:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea2e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a97c expref: 326 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.301268:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc 0) 00000100:00100000:0.0:1769074925.301355:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67469:x1855007616111360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 562us (872us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.301364:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9460 00000100:00100000:1.0:1769074925.302504:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111232 00000100:00100000:1.0:1769074925.302519:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111232 00000100:00100000:1.0:1769074925.302616:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 180 00000100:00100000:1.0:1769074925.302626:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2419:x1855007616111232:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074925.302664:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.302684:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea2f7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a975 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.302751:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.302767:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302778:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302794:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.302800:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302806:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302861:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302869:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302877:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302883:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.302888:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302896:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302913:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.302916:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.302921:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302928:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea2fe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302942:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302948:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302954:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302959:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.302962:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302967:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302974:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff916052708500) 00010000:00010000:1.0:1769074925.302977:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.302980:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.302985:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea305 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.303032:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea2f7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a975 expref: 326 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.303041:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.303044:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074925.303047:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea2f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a975 expref: 326 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.303056:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc -2) 00000100:00100000:1.0:1769074925.303137:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:2419:x1855007616111232:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 512us (3129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074925.303145:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 180 00000100:00100000:3.0:1769074925.317777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.317901:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111488 00000100:00100000:1.0:1769074925.317916:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111488 00000100:00100000:1.0:1769074925.317991:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9461 00000100:00100000:1.0:1769074925.318003:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67470:x1855007616111488:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.318032:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.318059:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea30c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a983 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.318169:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.318189:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318202:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318219:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.318230:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318236:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318303:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318320:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318327:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318335:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318342:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.318346:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318354:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318368:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.318371:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.318377:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318383:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea313 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318408:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318414:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318419:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318423:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.318426:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318432:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318439:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916052708500) 00010000:00010000:1.0:1769074925.318442:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.318444:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318451:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea31a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.318487:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea30c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a983 expref: 326 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.318498:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.318500:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.318503:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea30c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a983 expref: 326 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.318513:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc 0) 00000100:00100000:1.0:1769074925.318780:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67470:x1855007616111488:12345-192.168.204.32@tcp:101:cp.0 Request processed in 777us (1015us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074925.318789:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9461 00000100:00100000:1.0:1769074925.335916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.336310:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111616 00000100:00100000:3.0:1769074925.336325:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111616 00000100:00100000:3.0:1769074925.336403:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9462 00000100:00100000:3.0:1769074925.336415:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67470:x1855007616111616:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.336444:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.336473:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea321 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a98a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.336597:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.336614:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336627:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336644:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.336651:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336657:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336729:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336736:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336743:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336750:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.336755:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336763:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336777:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.336780:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.336786:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336792:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea328 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336807:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336813:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336819:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336824:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.336827:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336832:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336839:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.336841:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.336844:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336850:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea32f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.336885:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea321 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a98a expref: 326 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.336896:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.336898:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.336902:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea321 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a98a expref: 326 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.336911:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074925.336999:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67470:x1855007616111616:12345-192.168.204.32@tcp:101:cp.0 Request processed in 586us (1098us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.337007:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9462 00000100:00100000:2.0:1769074925.345615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.345729:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616111872 00000100:00100000:1.0:1769074925.345743:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616111872 00000100:00100000:1.0:1769074925.345822:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9463 00000100:00100000:1.0:1769074925.345834:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+325:67470:x1855007616111872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.345863:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.345892:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea336 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a991 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.346056:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.346076:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346090:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346107:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.346115:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346121:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:1.0:1769074925.346501:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb9:0x0], index 1: 0 00010000:00010000:1.0:1769074925.346729:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea34b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.346742:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea34b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346748:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea34b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346786:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346792:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346798:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346806:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346812:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.346817:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346825:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346838:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.346842:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.346846:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346852:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea33d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:1.0:1769074925.346868:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2c05f91 reply state 0000000020dab3ef transno 4294969044 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346879:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.346884:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916052708500) 00010000:00010000:1.0:1769074925.346887:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074925.346889:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074925.346924:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea336 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a991 expref: 328 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.346937:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44000/0x557988ac98fea34b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a991 expref: 327 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.346944:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17b:0x0].0x0 (ffff916052708300) 00010000:00010000:1.0:1769074925.346946:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074925.346949:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44000, rc 0) 00000100:00100000:1.0:1769074925.347044:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67470:x1855007616111872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1213us (1445us total) trans 4294969044 rc 0/0 00000100:00100000:1.0:1769074925.347053:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9463 00000100:00100000:3.0:1769074925.356635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.357657:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112000 00000100:00100000:1.0:1769074925.357675:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112000 00000100:00100000:1.0:1769074925.357771:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2731 00000100:00100000:1.0:1769074925.357788:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+162:2419:x1855007616112000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.357813:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.357843:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a998 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074925.357875:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074925.357903:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.357906:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.357917:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.357937:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 163 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.357953:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc 0) 00000100:00100000:1.0:1769074925.358035:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616112000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 252us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074925.358043:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2731 00000100:00080000:2.0:1769074925.358556:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074925.362229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.362342:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112128 00000100:00100000:3.0:1769074925.362356:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112128 00000100:00100000:3.0:1769074925.362426:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2732 00000100:00100000:3.0:1769074925.362437:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:67470:x1855007616112128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.362460:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.362484:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a99f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.362523:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074925.362579:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074925.362581:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074925.362586:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a99f expref: 164 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.362626:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074925.362641:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:3.0:1769074925.362657:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626624768:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074925.362784:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161819cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074925.365621:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626624768:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074925.365671:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a99f expref: 164 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.365699:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ce00, rc 0) 00000100:00100000:3.0:1769074925.365774:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:67470:x1855007616112128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3338us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074925.365785:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2732 00000100:00100000:0.0:1769074925.367191:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.367358:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112256 00000100:00100000:2.0:1769074925.367370:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112256 00010000:00010000:2.0:1769074925.367442:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074925.367491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1893 00000100:00100000:2.0:1769074925.367502:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2419:x1855007616112256:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074925.367519:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074925.367607:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.367624:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.367654:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a45a00/0x557988ac98fea359 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a998 expref: 164 pid: 24564 timeout: 2014 lvb_type: 1 00010000:00010000:2.0:1769074925.367674:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.367677:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.367686:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a99f expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.367699:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a99f expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.367749:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91615db8ce00/0x557988ac98fea360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a99f expref: 163 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074925.367766:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626624896:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074925.367890:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074925.379471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.379712:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626624896:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074925.379768:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074925.379842:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616112256:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12340us (12657us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074925.379855:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1893 00000100:00100000:1.0:1769074925.381352:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112512 00000100:00100000:1.0:1769074925.381369:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112512 00000100:00100000:1.0:1769074925.381491:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1878 00000100:00100000:1.0:1769074925.381514:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+328:67470:x1855007616112512:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074925.382036:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67470:x1855007616112512:12345-192.168.204.32@tcp:35:cp.0 Request processed in 532us (2579us total) trans 4294969045 rc 0/0 00000100:00100000:1.0:1769074925.382045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1878 00000100:00100000:3.0:1769074925.465639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.465742:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112640 00000100:00100000:0.0:1769074925.465755:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112640 00000100:00100000:0.0:1769074925.465841:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9464 00000100:00100000:0.0:1769074925.465854:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67474:x1855007616112640:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074925.465882:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.465907:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea367 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9a6 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.465978:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.465992:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466001:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466012:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.466017:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466020:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466076:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466080:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466085:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466093:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.466097:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466103:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466113:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.466115:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.466119:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466122:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea36e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466133:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466137:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466141:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466154:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.466157:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466162:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466169:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff916174963700) 00010000:00010000:0.0:1769074925.466172:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.466175:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466181:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea375 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.466219:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea367 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9a6 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.466229:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.466232:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.466235:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea367 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9a6 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.466244:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49400, rc 0) 00000100:00100000:0.0:1769074925.466325:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67474:x1855007616112640:12345-192.168.204.32@tcp:101:bash.0 Request processed in 474us (701us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.466334:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9464 00000100:00100000:2.0:1769074925.480289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.480675:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112768 00000100:00100000:0.0:1769074925.480690:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112768 00000100:00100000:0.0:1769074925.480775:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 181 00000100:00100000:0.0:1769074925.480786:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:2418:x1855007616112768:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074925.480860:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.480885:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea37c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9ad expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.480954:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074925.480971:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.480984:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481000:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074925.481007:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481014:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481074:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481081:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481087:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481093:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.481097:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481104:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481116:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.481119:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.481464:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481473:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea383 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481491:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481497:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481503:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481509:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.481511:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481518:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481527:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff916174963700) 00010000:00010000:0.0:1769074925.481581:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.481585:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481591:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fea38a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.481628:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea37c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9ad expref: 330 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.481639:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.481642:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074925.481646:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea37c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9ad expref: 330 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.481660:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49400, rc -2) 00000100:00100000:0.0:1769074925.481928:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:2418:x1855007616112768:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1141us (1654us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074925.481939:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 181 00000100:00100000:3.0:1769074925.485116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.488408:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616112896 00000100:00100000:0.0:1769074925.488432:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616112896 00000100:00100000:0.0:1769074925.488554:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9465 00000100:00100000:0.0:1769074925.488566:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67475:x1855007616112896:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074925.488595:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.488622:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea391 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9e5 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.488713:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.488732:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488745:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488773:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074925.488781:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488787:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488857:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488864:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488871:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488877:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.488882:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488890:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488903:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.488907:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.488913:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488919:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea398 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488932:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488938:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488943:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488948:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.488951:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488956:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488962:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff916174963600) 00010000:00010000:0.0:1769074925.488965:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.488968:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.488972:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea39f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074925.489007:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea391 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9e5 expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.489017:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.489020:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.489023:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea391 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9e5 expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.489031:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49200, rc 0) 00000100:00100000:0.0:1769074925.490449:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67475:x1855007616112896:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1871us (5331us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.490463:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9465 00000100:00100000:2.0:1769074925.495224:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.495437:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113024 00000100:00100000:3.0:1769074925.495452:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113024 00000100:00100000:3.0:1769074925.495559:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9466 00000100:00100000:3.0:1769074925.495571:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67475:x1855007616113024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074925.495598:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.495625:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9ec expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.495715:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.495735:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495749:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495777:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.495783:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495793:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495863:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495871:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495878:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495884:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.495888:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495896:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495910:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.495914:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.495919:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495925:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495940:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495945:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495950:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495956:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.495959:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495965:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495972:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.495974:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.495976:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.495981:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.496020:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3a6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9ec expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.496031:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.496033:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.496036:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9ec expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.496045:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ca00, rc 0) 00000100:00100000:3.0:1769074925.496138:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67475:x1855007616113024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 569us (928us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.496154:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9466 00000040:00080000:3.0:1769074925.496741:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1769074925.496749:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769074925.498489:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1769074925.499376:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1769074925.518739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.518805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.518917:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113280 00000100:00100000:0.0:1769074925.518931:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113280 00000100:00100000:0.0:1769074925.519007:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 182 00000100:00100000:0.0:1769074925.519018:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:2417:x1855007616113280:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074925.519096:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.519151:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea3bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9fa expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.519234:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074925.519253:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519266:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519282:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074925.519289:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519294:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519362:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519369:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519376:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519381:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.519386:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519399:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519413:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.519417:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.519423:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519429:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea3c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519443:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519448:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519454:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519458:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.519461:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519467:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519474:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff916174963600) 00010000:00010000:0.0:1769074925.519477:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.519480:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519485:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea3c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074925.519519:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea3bb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9fa expref: 330 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.519594:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.519597:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074925.519601:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea3bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9fa expref: 330 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.519611:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49200, rc -2) 00000100:00100000:0.0:1769074925.519689:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:2417:x1855007616113280:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 672us (882us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074925.519698:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 182 00000100:00100000:1.0:1769074925.520490:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113152 00000100:00100000:1.0:1769074925.520500:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113152 00000100:00100000:1.0:1769074925.520584:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9467 00000100:00100000:1.0:1769074925.520594:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67478:x1855007616113152:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.520612:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.520631:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea3d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2a9f3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.520703:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.520716:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520726:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520740:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074925.520747:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520763:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520814:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520821:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520827:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520832:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520837:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.520840:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520850:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520861:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.520864:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.520867:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520873:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea3d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520884:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520889:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520894:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520898:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.520900:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520905:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520910:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff916052708700) 00010000:00010000:1.0:1769074925.520912:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.520914:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520920:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea3de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074925.520949:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea3d0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9f3 expref: 330 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.520958:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.520960:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.520964:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea3d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2a9f3 expref: 330 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.520973:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc 0) 00000100:00100000:1.0:1769074925.521037:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67478:x1855007616113152:12345-192.168.204.32@tcp:101:cp.0 Request processed in 444us (2316us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074925.521044:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9467 00000100:00100000:0.0:1769074925.528014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.528229:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113408 00000100:00100000:3.0:1769074925.528243:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113408 00000100:00100000:3.0:1769074925.528323:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9468 00000100:00100000:3.0:1769074925.528333:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67478:x1855007616113408:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.528360:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.528386:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa32 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.528477:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.528507:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.528520:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529055:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.529066:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529074:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529402:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529415:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529424:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529430:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.529435:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529442:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529457:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.529461:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.529468:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529474:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea3ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.529489:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530062:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530070:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530074:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.530078:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530089:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530099:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.530102:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.530104:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530110:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea3f3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.530185:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3e5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa32 expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.530197:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.530199:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.530203:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea3e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa32 expref: 330 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.530213:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f989800, rc 0) 00000100:00100000:3.0:1769074925.530340:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67478:x1855007616113408:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2007us (2340us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.530352:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9468 00000100:00100000:0.0:1769074925.535483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.535681:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113664 00000100:00100000:3.0:1769074925.535695:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113664 00000100:00100000:3.0:1769074925.535789:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9469 00000100:00100000:3.0:1769074925.535801:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+329:67478:x1855007616113664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.535828:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.535858:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea3fa lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa39 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.536015:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.536032:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.536044:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.536060:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x26770847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.536066:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.536071:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:3.0:1769074925.536846:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb9:0x0], index 0: 0 00010000:00010000:3.0:1769074925.537217:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fea40f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074925.537232:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fea40f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537242:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fea40f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537286:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537292:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537300:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537306:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.537311:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537319:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537334:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.537337:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.537343:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537348:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea401 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:3.0:1769074925.537365:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bd039991 reply state 000000004219670a transno 4294969046 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537377:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074925.537383:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff91604e24c700) 00010000:00010000:3.0:1769074925.537385:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074925.537389:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074925.538704:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea3fa lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa39 expref: 332 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.538746:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246200/0x557988ac98fea40f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa39 expref: 331 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.538880:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17c:0x0].0x0 (ffff91604e401b00) 00010000:00010000:3.0:1769074925.538883:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074925.538887:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246200, rc 0) 00000100:00100000:2.0:1769074925.539149:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67478:x1855007616113664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3340us (3671us total) trans 4294969046 rc 0/0 00000100:00100000:2.0:1769074925.539162:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9469 00000100:00100000:2.0:1769074925.544264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.544509:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113792 00000100:00100000:3.0:1769074925.544525:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113792 00000100:00100000:3.0:1769074925.544635:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2733 00000100:00100000:3.0:1769074925.544647:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2419:x1855007616113792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.544671:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.544700:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa40 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074925.544741:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074925.545220:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074925.545225:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074925.545237:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074925.545259:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074925.545277:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246400, rc 0) 00000100:00100000:2.0:1769074925.546081:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:2419:x1855007616113792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1427us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.546093:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2733 00000100:00100000:0.0:1769074925.550808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.551266:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616113920 00000100:00100000:2.0:1769074925.551280:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616113920 00000100:00100000:2.0:1769074925.551363:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2734 00000100:00100000:2.0:1769074925.551374:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:67478:x1855007616113920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.551398:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.551422:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa47 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.551466:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 166 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.551475:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.551478:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.551484:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa47 expref: 166 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.551916:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 166 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.551936:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 166 pid: 25313 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074925.551953:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626625024:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074925.552132:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47780 going to sleep for 11 seconds 00000100:00100000:0.0:1769074925.557247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.558005:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114048 00000100:00100000:1.0:1769074925.558020:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114048 00010000:00010000:1.0:1769074925.558099:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 167 pid: 25313 timeout: 2014 lvb_type: 1 00000100:00100000:1.0:1769074925.558167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1894 00000100:00100000:1.0:1769074925.558179:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+167:2420:x1855007616114048:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074925.558198:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074925.558223:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 167 pid: 25313 timeout: 2014 lvb_type: 1 00010000:00010000:1.0:1769074925.558241:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 167 pid: 25313 timeout: 2014 lvb_type: 1 00010000:00010000:1.0:1769074925.558282:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.558284:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.558294:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa47 expref: 167 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.558319:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa47 expref: 167 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.558371:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa47 expref: 167 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074925.558390:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626625152:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074925.558652:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617feea480 going to sleep for 11 seconds 00000100:00100000:1.0:1769074925.561435:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626625152:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074925.561471:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074925.561586:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+167:2420:x1855007616114048:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3407us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074925.561598:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1894 00010000:00010000:2.0:1769074925.562034:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e246400/0x557988ac98fea41d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa40 expref: 166 pid: 25313 timeout: 2014 lvb_type: 1 00000100:00100000:2.0:1769074925.562054:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626625024:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074925.562078:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916044c6a400/0x557988ac98fea424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa47 expref: 165 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.562095:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a400, rc 0) 00000100:00100000:2.0:1769074925.562226:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:67478:x1855007616113920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10852us (11432us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.562236:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2734 00000100:00100000:0.0:1769074925.566706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.566858:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114304 00000100:00100000:1.0:1769074925.566872:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114304 00000100:00100000:1.0:1769074925.567031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1879 00000100:00100000:1.0:1769074925.567043:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+332:67478:x1855007616114304:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074925.567471:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67478:x1855007616114304:12345-192.168.204.32@tcp:35:cp.0 Request processed in 429us (781us total) trans 4294969047 rc 0/0 00000100:00100000:1.0:1769074925.567481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1879 00000100:00100000:0.0:1769074925.590745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.590839:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114432 00000100:00100000:3.0:1769074925.590853:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114432 00000100:00100000:3.0:1769074925.590929:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 183 00000100:00100000:3.0:1769074925.590941:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2418:x1855007616114432:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074925.591016:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.591041:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea42b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa4e expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.591111:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074925.591216:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591235:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591255:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074925.591262:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591268:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591333:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591340:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591347:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591354:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.591358:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591366:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591379:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.591382:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.591388:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591393:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea432 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591407:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591412:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591418:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591423:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.591425:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591430:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591437:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.591439:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.591442:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591447:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea439 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074925.591481:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea42b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa4e expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.591492:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.591494:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074925.591497:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea42b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa4e expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.591507:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc -2) 00000100:00100000:2.0:1769074925.592294:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2418:x1855007616114432:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1349us (1559us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074925.593342:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 183 00000100:00100000:0.0:1769074925.599643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.600674:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114560 00000100:00100000:2.0:1769074925.600692:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114560 00000100:00100000:2.0:1769074925.600789:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9470 00000100:00100000:2.0:1769074925.600801:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67485:x1855007616114560:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074925.600829:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.600860:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea440 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa86 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.600948:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.600967:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.600981:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.600997:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.601003:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601009:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601084:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601093:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601100:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601107:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.601112:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601120:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601675:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.601679:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.601685:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601692:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea447 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601709:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601715:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601721:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601727:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.601729:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601739:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.601749:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.602238:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.602244:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.602251:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea44e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.602379:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea440 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa86 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.602391:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.602394:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.602398:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea440 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa86 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.602408:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:2.0:1769074925.602509:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67485:x1855007616114560:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1708us (2880us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.602519:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9470 00000100:00100000:0.0:1769074925.617691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.617749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.617907:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114688 00000100:00100000:2.0:1769074925.617922:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114688 00000100:00100000:2.0:1769074925.618002:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9471 00000100:00100000:2.0:1769074925.618013:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67486:x1855007616114688:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074925.618041:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.618070:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea455 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa8d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.618186:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.618205:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618219:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618235:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.618242:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618250:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618330:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618338:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618345:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618352:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.618358:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618366:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618381:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.618385:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.618391:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618398:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea45c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618412:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618418:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618423:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618428:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.618431:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618439:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618446:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.618448:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.618450:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618455:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea463 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.618504:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea455 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa8d expref: 334 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.618515:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.618518:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.618522:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea455 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa8d expref: 334 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.618581:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:2.0:1769074925.618654:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67486:x1855007616114688:12345-192.168.204.32@tcp:101:rm.0 Request processed in 643us (979us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.618661:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9471 00000100:00100000:1.0:1769074925.619063:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114816 00000100:00100000:1.0:1769074925.619071:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114816 00000100:00100000:1.0:1769074925.619126:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 184 00000100:00100000:1.0:1769074925.619134:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2417:x1855007616114816:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074925.619176:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.619191:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea46a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa94 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.619236:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.619248:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619258:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619272:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.619279:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619286:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619337:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619345:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619350:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619356:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.619359:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619366:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619376:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.619379:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.619383:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619388:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea471 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619400:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619405:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619411:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619416:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.619419:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619424:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619431:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052708700) 00010000:00010000:1.0:1769074925.619433:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.619436:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619443:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea478 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.619466:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea46a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa94 expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.619474:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.619476:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074925.619480:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea46a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa94 expref: 334 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.619488:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc -2) 00000100:00100000:1.0:1769074925.619775:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:2417:x1855007616114816:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 641us (2024us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074925.619785:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 184 00000100:00100000:0.0:1769074925.625115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.625225:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616114944 00000100:00100000:3.0:1769074925.625239:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616114944 00000100:00100000:3.0:1769074925.625425:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9472 00000100:00100000:3.0:1769074925.625438:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67486:x1855007616114944:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074925.625466:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.625977:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea47f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aa9b expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.626077:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.626100:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626115:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626134:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.626140:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626155:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626234:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626243:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626250:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626257:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626264:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.626269:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626277:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626292:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.626295:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.626440:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626450:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea486 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626468:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626475:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626480:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626487:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.626692:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626703:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626711:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.626714:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.626717:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626723:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea48d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.626844:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea47f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa9b expref: 334 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.626859:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.626862:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.626866:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea47f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aa9b expref: 334 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.626877:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc 0) 00000100:00100000:3.0:1769074925.627012:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67486:x1855007616114944:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1575us (1910us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.627021:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9472 00000100:00100000:0.0:1769074925.644484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.644639:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115072 00000100:00100000:3.0:1769074925.644655:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115072 00000100:00100000:3.0:1769074925.644734:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9473 00000100:00100000:3.0:1769074925.644746:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67487:x1855007616115072:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.644786:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.644817:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea494 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aaa2 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.644911:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.644929:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.644942:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.644958:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.644965:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.644970:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645041:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645048:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645054:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645060:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645067:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.645071:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645080:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645093:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.645097:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.645103:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645109:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea49b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645126:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645132:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645137:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645152:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.645155:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645161:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645168:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.645170:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.645174:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645179:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.645216:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea494 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaa2 expref: 334 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.645228:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.645231:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.645234:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea494 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaa2 expref: 334 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.645244:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc 0) 00000100:00100000:3.0:1769074925.645327:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67487:x1855007616115072:12345-192.168.204.32@tcp:101:cp.0 Request processed in 583us (861us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.645336:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9473 00000100:00100000:1.0:1769074925.649648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.649941:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115200 00000100:00100000:2.0:1769074925.649956:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115200 00000100:00100000:2.0:1769074925.650035:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9474 00000100:00100000:2.0:1769074925.650047:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67487:x1855007616115200:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.650075:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.650101:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea4a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aaa9 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.650204:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.650223:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650239:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650254:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.650266:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650272:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650351:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650360:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650367:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650374:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.650379:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650386:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650403:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.650407:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.650413:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650420:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea4b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650436:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650441:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650447:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650452:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6b200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.650455:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650461:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650468:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.650471:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.650473:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650479:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6b200/0x557988ac98fea4b7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.650525:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea4a9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaa9 expref: 334 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.650571:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.650574:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.650578:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea4a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaa9 expref: 334 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.650587:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:2.0:1769074925.650660:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67487:x1855007616115200:12345-192.168.204.32@tcp:101:cp.0 Request processed in 615us (1028us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.650667:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9474 00000100:00100000:0.0:1769074925.655245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.655427:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115456 00000100:00100000:3.0:1769074925.655441:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115456 00000100:00100000:3.0:1769074925.656057:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9475 00000100:00100000:3.0:1769074925.656073:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+333:67487:x1855007616115456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.656101:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.656131:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4be lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aab0 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.656317:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.656336:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.656352:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.656368:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.656376:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.656382:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:3.0:1769074925.657137:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xba:0x0], index 1: 0 00010000:00010000:3.0:1769074925.657357:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fea4d3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.657372:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fea4d3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657382:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fea4d3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657424:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657432:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657440:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657447:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657459:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.657465:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657473:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.657489:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.658212:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.658219:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.658230:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4c5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:3.0:1769074925.658250:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc0d248a reply state 00000000ec1cbc18 transno 4294969048 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.658262:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.658268:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604e24c000) 00010000:00010000:3.0:1769074925.658271:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074925.658274:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074925.658405:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4be lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab0 expref: 336 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.658424:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246400/0x557988ac98fea4d3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab0 expref: 335 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.658433:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17d:0x0].0x0 (ffff91604f135a00) 00010000:00010000:3.0:1769074925.658436:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074925.658439:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246400, rc 0) 00000100:00100000:3.0:1769074925.658960:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67487:x1855007616115456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2888us (3729us total) trans 4294969048 rc 0/0 00000100:00100000:3.0:1769074925.658970:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9475 00000100:00100000:0.0:1769074925.665682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.665972:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115584 00000100:00100000:2.0:1769074925.665986:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115584 00000100:00100000:2.0:1769074925.666098:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2735 00000100:00100000:2.0:1769074925.666110:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+163:2419:x1855007616115584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.666135:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.666196:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aab7 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074925.666226:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074925.666256:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.666258:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.666269:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 164 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.666293:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 164 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.666319:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a800, rc 0) 00000100:00100000:2.0:1769074925.666403:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2419:x1855007616115584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 294us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.666411:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2735 00000100:00100000:1.0:1769074925.669622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.670055:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115712 00000100:00100000:2.0:1769074925.670069:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115712 00000100:00100000:2.0:1769074925.670134:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2736 00000100:00100000:2.0:1769074925.670154:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:67487:x1855007616115712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.670178:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.670202:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aabe expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.670243:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.670252:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.670255:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.670259:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aabe expref: 165 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.670311:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074925.670329:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074925.670346:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626625280:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074925.670486:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47a80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074925.673192:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604f182680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626625280:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074925.673241:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aabe expref: 165 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.673264:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6b200, rc 0) 00000100:00100000:2.0:1769074925.673349:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:67487:x1855007616115712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3205us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.673361:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2736 00000100:00100000:1.0:1769074925.675780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.676650:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616115840 00000100:00100000:0.0:1769074925.676665:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616115840 00010000:00010000:1.0:1769074925.676911:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:1.0:1769074925.677004:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1895 00000100:00100000:1.0:1769074925.677017:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:2420:x1855007616115840:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074925.677037:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074925.677062:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:1.0:1769074925.677083:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:1.0:1769074925.677111:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916044c6a800/0x557988ac98fea4e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aab7 expref: 165 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:1.0:1769074925.677130:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.677132:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.677150:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aabe expref: 164 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.677162:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aabe expref: 164 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.677211:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6b200/0x557988ac98fea4e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aabe expref: 164 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074925.677231:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626625408:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074925.677360:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074925.681103:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.681246:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116096 00000100:00100000:3.0:1769074925.681259:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116096 00000100:00100000:3.0:1769074925.681338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1880 00000100:00100000:3.0:1769074925.681349:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+336:67487:x1855007616116096:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074925.681802:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67487:x1855007616116096:12345-192.168.204.32@tcp:35:cp.0 Request processed in 453us (712us total) trans 4294969049 rc 0/0 00000100:00100000:3.0:1769074925.681811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1880 00000100:00100000:2.0:1769074925.682914:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626625408:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074925.682945:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074925.682985:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2420:x1855007616115840:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5971us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.682994:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1895 00000100:00100000:1.0:1769074925.719244:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.719432:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116224 00000100:00100000:3.0:1769074925.719447:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116224 00000100:00100000:3.0:1769074925.719570:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9476 00000100:00100000:3.0:1769074925.719583:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67490:x1855007616116224:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074925.719610:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.719638:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea4ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aac5 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.719729:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.719746:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719769:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719790:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.719796:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719803:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719872:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719880:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719886:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719893:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719900:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.719905:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719913:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719927:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.719930:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.719936:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719942:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea4f6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719958:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719964:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719970:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719974:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.719977:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719982:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.719989:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604f135800) 00010000:00010000:3.0:1769074925.719992:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.719995:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.720000:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea4fd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.720036:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea4ef lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aac5 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.720047:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.720049:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.720053:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea4ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aac5 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.720067:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074925.720156:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67490:x1855007616116224:12345-192.168.204.32@tcp:101:bash.0 Request processed in 575us (926us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.720164:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9476 00000100:00100000:0.0:1769074925.729405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.729519:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116352 00000100:00100000:2.0:1769074925.729570:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116352 00000100:00100000:2.0:1769074925.729641:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 185 00000100:00100000:2.0:1769074925.729653:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:2419:x1855007616116352:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074925.729706:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.729731:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea504 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aacc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.729817:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.729836:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729848:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729865:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074925.729871:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729878:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729947:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729955:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729963:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729969:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.729974:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729983:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.729996:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.730000:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.730005:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730012:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea50b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730025:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730031:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730036:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730041:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.730043:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730053:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730059:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.730060:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.730063:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730067:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea512 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074925.730095:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea504 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aacc expref: 338 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.730104:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.730106:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074925.730110:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea504 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aacc expref: 338 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.730118:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc -2) 00000100:00100000:2.0:1769074925.730207:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:2419:x1855007616116352:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 555us (816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074925.730216:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 185 00000100:00100000:1.0:1769074925.733086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.733243:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116480 00000100:00100000:2.0:1769074925.733256:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116480 00000100:00100000:2.0:1769074925.733333:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9477 00000100:00100000:2.0:1769074925.733343:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67491:x1855007616116480:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074925.733369:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.733398:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea519 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aad3 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.733487:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.733516:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733564:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733582:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.733589:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733596:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733671:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733679:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733685:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733692:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.733696:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733704:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733718:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.733721:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.733726:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733732:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea520 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733746:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733763:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733769:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733774:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.733777:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733782:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733789:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604faeb000) 00010000:00010000:2.0:1769074925.733792:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.733794:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733801:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea527 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.733835:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea519 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aad3 expref: 338 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.733845:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.733848:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.733852:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea519 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aad3 expref: 338 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.733860:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f800, rc 0) 00000100:00100000:2.0:1769074925.733929:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67491:x1855007616116480:12345-192.168.204.32@tcp:101:rm.0 Request processed in 587us (857us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.733937:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9477 00000100:00100000:0.0:1769074925.737450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.737804:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116608 00000100:00100000:3.0:1769074925.737818:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116608 00000100:00100000:3.0:1769074925.737937:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9478 00000100:00100000:3.0:1769074925.737951:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67491:x1855007616116608:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074925.737979:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.738008:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea52e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aada expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.738100:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.738118:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738131:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738157:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074925.738164:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738171:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738249:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738257:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738263:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738269:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738275:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.738280:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738287:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738301:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.738305:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.738311:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738317:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea535 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738333:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738338:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738344:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738350:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074925.738353:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738359:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738366:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604f135800) 00010000:00010000:3.0:1769074925.738367:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.738370:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738375:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea53c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074925.738411:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea52e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aada expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.738422:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074925.738424:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074925.738428:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea52e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aada expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.738438:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246e00, rc 0) 00000100:00100000:3.0:1769074925.738903:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67491:x1855007616116608:12345-192.168.204.32@tcp:101:rm.0 Request processed in 951us (1464us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074925.738914:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9478 00010000:00010000:1.0:1769074925.747864:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074925.751194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.751283:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116736 00000100:00100000:3.0:1769074925.751296:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116736 00000100:00100000:3.0:1769074925.751382:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9479 00000100:00100000:3.0:1769074925.751394:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67492:x1855007616116736:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074925.751421:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074925.751452:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea543 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aae1 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.751887:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.751905:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.751917:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.751934:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.751940:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.751946:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752014:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752022:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752029:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752036:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752043:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.752049:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752058:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752070:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.752074:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.752079:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752085:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea54a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752101:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752107:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752113:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752117:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.752120:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752126:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752132:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff916174963600) 00010000:00010000:0.0:1769074925.752135:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.752137:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752155:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea551 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.752194:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea543 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aae1 expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.752205:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.752208:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.752212:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea543 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aae1 expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.752222:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:0.0:1769074925.752313:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67492:x1855007616116736:12345-192.168.204.32@tcp:101:cp.0 Request processed in 920us (1134us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.752321:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9479 00000100:00100000:1.0:1769074925.757852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.757948:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616116864 00000100:00100000:0.0:1769074925.757961:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616116864 00000100:00100000:0.0:1769074925.758039:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9480 00000100:00100000:0.0:1769074925.758050:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67492:x1855007616116864:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.758078:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.758105:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea558 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aae8 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.758203:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.758221:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758235:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758256:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.758263:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758269:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758353:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758361:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758368:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758375:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758381:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.758386:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758395:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758409:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.758413:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.758418:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758425:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea55f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758440:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758445:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758450:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758454:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.758457:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758462:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758468:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff916174963600) 00010000:00010000:0.0:1769074925.758471:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.758473:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758478:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fea566 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.758522:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea558 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aae8 expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.758581:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.758583:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.758588:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98fea558 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aae8 expref: 338 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.758602:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074925.758681:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67492:x1855007616116864:12345-192.168.204.32@tcp:101:cp.0 Request processed in 632us (844us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.758690:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9480 00000100:00100000:1.0:1769074925.764324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.764433:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117120 00000100:00100000:2.0:1769074925.764448:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117120 00000100:00100000:2.0:1769074925.764656:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9481 00000100:00100000:2.0:1769074925.764669:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+337:67492:x1855007616117120:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.764697:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.764724:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea56d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aaef expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.764896:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.764916:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.764930:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.764947:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe62d025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.764957:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.764963:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074925.765420:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xba:0x0], index 0: 0 00010000:00010000:2.0:1769074925.765628:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fea582 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.765638:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fea582 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765646:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fea582 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765684:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765693:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765701:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765709:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.765714:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765721:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765736:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.765740:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.765745:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765751:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea574 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074925.765765:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000085acc065 reply state 00000000dec3b26f transno 4294969050 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765776:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.765782:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604faeb000) 00010000:00010000:2.0:1769074925.765785:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074925.765788:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074925.765826:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea56d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaef expref: 340 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.765841:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fe00/0x557988ac98fea582 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaef expref: 339 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.765848:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17e:0x0].0x0 (ffff91604faeb300) 00010000:00010000:2.0:1769074925.765851:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074925.765853:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fe00, rc 0) 00000100:00100000:2.0:1769074925.765950:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67492:x1855007616117120:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1283us (1649us total) trans 4294969050 rc 0/0 00000100:00100000:2.0:1769074925.767877:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9481 00000100:00100000:3.0:1769074925.772132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.772189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.772226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.772329:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117376 00000100:00100000:0.0:1769074925.772343:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117376 00000100:00100000:0.0:1769074925.772417:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2737 00000100:00100000:0.0:1769074925.772428:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+165:2420:x1855007616117376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.772453:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.772480:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aaf6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074925.772509:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074925.772562:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.772565:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.772576:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 166 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.772596:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 166 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.772612:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074925.772679:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+166:2420:x1855007616117376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 252us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074925.772687:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2737 00000100:00100000:2.0:1769074925.772785:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117248 00000100:00100000:2.0:1769074925.772790:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117248 00002000:00100000:2.0:1769074925.772829:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x57:0x0] (0->157) req@ffff916043582300 x1855007616117248/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074925.772844:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043582300 with x1855007616117248 ext(0->157) 00002000:00010000:2.0:1769074925.772851:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916043582300 00000100:00100000:2.0:1769074925.772866:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117504 00000100:00100000:2.0:1769074925.772869:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117504 00002000:00100000:2.0:1769074925.772882:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x57:0x0] (0->157) req@ffff916043581180 x1855007616117504/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074925.772891:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581180 with x1855007616117504 ext(0->157) 00002000:00010000:2.0:1769074925.772895:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581180 00000100:00100000:2.0:1769074925.772910:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 657 00000100:00100000:2.0:1769074925.772917:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+164:2418:x1855007616117248:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074925.773575:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 658 00000100:00100000:0.0:1769074925.773587:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+166:2418:x1855007616117504:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074925.774582:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+168:2418:x1855007616117504:12345-192.168.204.32@tcp:4:cp.0 Request processed in 989us (2346us total) trans 4294967845 rc 0/0 00000100:00100000:0.0:1769074925.774594:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 658 00002000:00100000:0.0:1769074925.774604:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x57:0x0] (0->157) req@ffff916043581180 x1855007616117504/t4294967845(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074925.774613:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581180 with x1855007616117504 ext(0->157) 00002000:00010000:0.0:1769074925.774619:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581180 00000100:00100000:2.0:1769074925.775596:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+166:2418:x1855007616117248:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2672us (3474us total) trans 4294967856 rc 0/0 00000100:00100000:2.0:1769074925.775609:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 657 00002000:00100000:2.0:1769074925.775620:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x57:0x0] (0->157) req@ffff916043582300 x1855007616117248/t4294967856(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074925.775629:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043582300 with x1855007616117248 ext(0->157) 00002000:00010000:2.0:1769074925.775635:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916043582300 00000100:00100000:1.0:1769074925.781928:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.781977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.782008:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074925.782286:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117632 00000100:00100000:3.0:1769074925.782308:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117632 00002000:00100000:3.0:1769074925.782373:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x58:0x0] (0->157) req@ffff916044b11180 x1855007616117632/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074925.782386:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11180 with x1855007616117632 ext(0->157) 00002000:00010000:3.0:1769074925.782394:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b11180 00000100:00100000:3.0:1769074925.782423:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117760 00000100:00100000:3.0:1769074925.782426:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117760 00002000:00100000:3.0:1769074925.782441:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x58:0x0] (0->157) req@ffff916044b13b80 x1855007616117760/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074925.782449:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13b80 with x1855007616117760 ext(0->157) 00002000:00010000:3.0:1769074925.782454:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13b80 00000100:00100000:3.0:1769074925.782467:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616117888 00000100:00100000:3.0:1769074925.782469:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616117888 00002000:00100000:3.0:1769074925.782479:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x59:0x0] (0->157) req@ffff916049c44a80 x1855007616117888/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074925.782487:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c44a80 with x1855007616117888 ext(0->157) 00002000:00010000:3.0:1769074925.782490:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c44a80 00000100:00100000:3.0:1769074925.782509:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 659 00000100:00100000:3.0:1769074925.782518:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+167:2417:x1855007616117632:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074925.783082:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 660 00000100:00100000:3.0:1769074925.783090:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+168:2417:x1855007616117760:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074925.783339:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 661 00000100:00100000:3.0:1769074925.783347:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+169:2418:x1855007616117888:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074925.784730:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+171:2417:x1855007616117632:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2200us (2804us total) trans 4294967857 rc 0/0 00000100:00100000:3.0:1769074925.784746:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 659 00002000:00100000:3.0:1769074925.784756:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x58:0x0] (0->157) req@ffff916044b11180 x1855007616117632/t4294967857(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074925.784767:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11180 with x1855007616117632 ext(0->157) 00002000:00010000:3.0:1769074925.784773:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b11180 00000100:00100000:0.0:1769074925.789417:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+170:2417:x1855007616117760:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6315us (7427us total) trans 4294967846 rc 0/0 00000100:00100000:0.0:1769074925.789435:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 660 00002000:00100000:0.0:1769074925.789452:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x58:0x0] (0->157) req@ffff916044b13b80 x1855007616117760/t4294967846(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074925.789464:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13b80 with x1855007616117760 ext(0->157) 00002000:00010000:0.0:1769074925.789470:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13b80 00000100:00100000:1.0:1769074925.789894:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+170:2418:x1855007616117888:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6538us (7875us total) trans 4294967858 rc 0/0 00000100:00100000:1.0:1769074925.789909:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 661 00002000:00100000:1.0:1769074925.789923:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x59:0x0] (0->157) req@ffff916049c44a80 x1855007616117888/t4294967858(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074925.789934:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c44a80 with x1855007616117888 ext(0->157) 00002000:00010000:1.0:1769074925.789940:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c44a80 00000100:00100000:0.0:1769074925.791821:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.792587:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118016 00000100:00100000:1.0:1769074925.792603:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118016 00000100:00100000:1.0:1769074925.792678:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2738 00000100:00100000:1.0:1769074925.792689:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+170:67492:x1855007616118016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.792713:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.792740:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aafd expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.792848:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 171 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.792859:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.792861:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.792866:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aafd expref: 171 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.792911:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 171 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.792933:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 171 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:1.0:1769074925.792950:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626625536:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074925.793062:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074925.794819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.794855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.795000:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118144 00000100:00100000:0.0:1769074925.795012:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118144 00002000:00100000:0.0:1769074925.795076:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x59:0x0] (0->157) req@ffff91604f182680 x1855007616118144/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074925.795089:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f182680 with x1855007616118144 ext(0->157) 00002000:00010000:0.0:1769074925.795096:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604f182680 00000100:00100000:0.0:1769074925.795121:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118272 00000100:00100000:0.0:1769074925.795125:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118272 00002000:00100000:0.0:1769074925.795152:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x5a:0x0] (0->157) req@ffff91617b57f100 x1855007616118272/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/0 e 0 to 0 dl 1769074936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074925.795161:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57f100 with x1855007616118272 ext(0->157) 00002000:00010000:0.0:1769074925.795165:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617b57f100 00000100:00100000:0.0:1769074925.795196:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 662 00000100:00100000:0.0:1769074925.795205:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+172:2417:x1855007616118144:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074925.795433:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 663 00000100:00100000:1.0:1769074925.795444:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+170:2417:x1855007616118272:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074925.800475:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+172:2417:x1855007616118272:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5017us (5601us total) trans 4294967859 rc 0/0 00000100:00100000:1.0:1769074925.800836:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 663 00002000:00100000:1.0:1769074925.800855:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x5a:0x0] (0->157) req@ffff91617b57f100 x1855007616118272/t4294967859(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074925.800867:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57f100 with x1855007616118272 ext(0->157) 00002000:00010000:1.0:1769074925.800874:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617b57f100 00000100:00100000:0.0:1769074925.801091:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2417:x1855007616118144:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5885us (6283us total) trans 4294967847 rc 0/0 00000100:00100000:0.0:1769074925.801101:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 662 00002000:00100000:0.0:1769074925.801107:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x59:0x0] (0->157) req@ffff91604f182680 x1855007616118144/t4294967847(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:461/0 lens 648/448 e 0 to 0 dl 1769074936 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074925.801116:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f182680 with x1855007616118144 ext(0->157) 00002000:00010000:0.0:1769074925.801120:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604f182680 00000100:00100000:1.0:1769074925.802796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.802872:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118400 00000100:00100000:2.0:1769074925.802884:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118400 00010000:00010000:2.0:1769074925.802950:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074925.803002:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1896 00000100:00100000:2.0:1769074925.803012:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2420:x1855007616118400:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074925.803029:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074925.803052:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074925.803066:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074925.803098:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.803101:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.803110:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aafd expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.803122:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aafd expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.803178:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aafd expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074925.803194:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626625664:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074925.803308:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47600 going to sleep for 11 seconds 00010000:00010000:3.0:1769074925.810176:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fea590 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aaf6 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:3.0:1769074925.810205:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626625536:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074925.810249:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052a44400/0x557988ac98fea597 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aafd expref: 173 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074925.810268:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44400, rc 0) 00000100:00100000:2.0:1769074925.811449:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:67492:x1855007616118016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 18754us (19632us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.811463:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2738 00000100:00100000:3.0:1769074925.811794:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626625664:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074925.811819:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074925.815264:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+172:2420:x1855007616118400:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12233us (12458us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074925.815283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1896 00000100:00100000:2.0:1769074925.817227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.817342:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118656 00000100:00100000:0.0:1769074925.817358:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118656 00000100:00100000:0.0:1769074925.817428:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1881 00000100:00100000:0.0:1769074925.817440:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+340:67492:x1855007616118656:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074925.818413:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67492:x1855007616118656:12345-192.168.204.32@tcp:35:cp.0 Request processed in 967us (1191us total) trans 4294969051 rc 0/0 00000100:00100000:0.0:1769074925.818426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1881 00000100:00100000:1.0:1769074925.855840:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.855961:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118784 00000100:00100000:2.0:1769074925.855975:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118784 00000100:00100000:2.0:1769074925.856052:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9482 00000100:00100000:2.0:1769074925.856064:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67495:x1855007616118784:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074925.856093:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.856122:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea59e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab04 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.856217:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.856234:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856247:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856261:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.856268:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856274:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856352:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856360:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856366:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856374:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.856379:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856387:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856401:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.856404:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.856410:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856415:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856432:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856438:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856444:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856449:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.856452:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856458:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856465:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faebf00) 00010000:00010000:2.0:1769074925.856467:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.856470:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856475:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.856512:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea59e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab04 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.856523:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.856525:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.856580:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea59e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab04 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.856591:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074925.856676:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67495:x1855007616118784:12345-192.168.204.32@tcp:101:bash.0 Request processed in 613us (850us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.856684:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9482 00000100:00100000:2.0:1769074925.873526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.873788:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616118912 00000100:00100000:0.0:1769074925.873802:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616118912 00000100:00100000:0.0:1769074925.873877:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9483 00000100:00100000:0.0:1769074925.873889:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67496:x1855007616118912:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074925.873928:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.873956:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea5b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab0b expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.874050:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.874070:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874084:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874101:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074925.874108:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874115:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874195:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874203:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874210:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874217:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874224:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.874230:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874239:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874253:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.874257:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.874263:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874270:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea5ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874285:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874291:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874296:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874301:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074925.874303:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874308:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874315:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff916174963b00) 00010000:00010000:0.0:1769074925.874318:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.874321:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874331:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49000/0x557988ac98fea5c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074925.874365:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea5b3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab0b expref: 342 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.874376:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074925.874378:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074925.874382:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea5b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab0b expref: 342 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.874392:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49400, rc 0) 00000100:00100000:0.0:1769074925.874472:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67496:x1855007616118912:12345-192.168.204.32@tcp:101:rm.0 Request processed in 585us (962us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074925.874480:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9483 00000100:00100000:3.0:1769074925.881129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.881249:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119040 00000100:00100000:1.0:1769074925.881263:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119040 00000100:00100000:1.0:1769074925.881341:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 186 00000100:00100000:1.0:1769074925.881352:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:2418:x1855007616119040:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074925.881413:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.881440:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea5c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab12 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.881579:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.881598:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881612:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881630:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074925.881638:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881646:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881717:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881724:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881730:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881736:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.881740:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881760:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881779:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.881783:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.881788:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881794:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea5cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881819:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881826:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881832:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881837:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074925.881840:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881846:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881853:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff916052708700) 00010000:00010000:1.0:1769074925.881855:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074925.881858:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881864:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea5d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074925.881897:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea5c8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab12 expref: 342 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.881908:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074925.881911:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074925.881915:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea5c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab12 expref: 342 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074925.881924:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45400, rc -2) 00000100:00100000:1.0:1769074925.882003:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:2418:x1855007616119040:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 652us (890us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074925.882011:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 186 00000100:00100000:1.0:1769074925.886112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.886369:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119168 00000100:00100000:2.0:1769074925.886383:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119168 00000100:00100000:2.0:1769074925.886457:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9484 00000100:00100000:2.0:1769074925.886469:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67496:x1855007616119168:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074925.888448:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.888881:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5dd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab19 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.889023:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.889047:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889062:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889080:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.889088:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889094:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889178:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889186:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889193:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889200:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.889204:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889212:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889227:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.889231:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.889237:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889243:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea5e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889260:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889266:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889272:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889277:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.889280:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889286:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.889293:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faebf00) 00010000:00010000:2.0:1769074925.889296:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.890029:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.890042:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.890096:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5dd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab19 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.890105:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.890108:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.890111:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab19 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.890241:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074925.890489:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67496:x1855007616119168:12345-192.168.204.32@tcp:101:rm.0 Request processed in 4020us (4387us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.890501:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9484 00000100:00100000:0.0:1769074925.915789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.915987:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119296 00000100:00100000:2.0:1769074925.916003:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119296 00000100:00100000:2.0:1769074925.916082:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9485 00000100:00100000:2.0:1769074925.916094:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67497:x1855007616119296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.916379:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.916410:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab20 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.917247:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.917273:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917288:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917306:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.917313:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917320:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917394:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917402:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917409:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917415:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.917420:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917428:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917442:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.917445:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.917451:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917458:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea5f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917475:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917481:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917486:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917980:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.917985:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.917994:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.918003:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faebf00) 00010000:00010000:2.0:1769074925.918007:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.918010:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.918017:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea600 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.918071:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5f2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab20 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.918083:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.918086:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.918090:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea5f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab20 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.918100:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074925.918781:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67497:x1855007616119296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2684us (3001us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.918794:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9485 00000100:00100000:3.0:1769074925.922360:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.922465:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119424 00000100:00100000:2.0:1769074925.922478:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119424 00000100:00100000:2.0:1769074925.922553:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9486 00000100:00100000:2.0:1769074925.922569:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67497:x1855007616119424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.922596:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.922619:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea607 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab27 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.922691:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.922706:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922717:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922729:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.922734:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922738:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922806:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922810:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922814:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922820:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.922825:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922836:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922850:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.922853:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.922859:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922866:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea60e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922882:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922888:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922892:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922896:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.922897:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922901:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922905:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faebe00) 00010000:00010000:2.0:1769074925.922906:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.922908:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922911:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea615 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.922942:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea607 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab27 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.922951:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.922952:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.922955:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea607 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab27 expref: 342 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.922962:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074925.923280:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67497:x1855007616119424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 711us (934us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074925.923286:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9486 00000100:00100000:1.0:1769074925.927939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.928295:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119680 00000100:00100000:2.0:1769074925.928309:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119680 00000100:00100000:2.0:1769074925.928427:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9487 00000100:00100000:2.0:1769074925.928438:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+341:67497:x1855007616119680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074925.928466:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074925.928506:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea61c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab2e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.928713:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.928732:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.928745:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.928781:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.928788:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.928794:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074925.929404:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xbb:0x0], index 1: 0 00010000:00010000:2.0:1769074925.929733:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fea631 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074925.929912:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fea631 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.929924:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fea631 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.929970:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.929978:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.929985:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.929992:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074925.929997:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.930006:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.930021:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074925.930024:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074925.930029:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.930035:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea623 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074925.930051:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000041fb90f1 reply state 00000000ac4065d6 transno 4294969052 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.930063:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074925.930069:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faeb400) 00010000:00010000:2.0:1769074925.930071:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074925.930075:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074925.930341:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea61c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab2e expref: 344 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.930363:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7400/0x557988ac98fea631 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab2e expref: 343 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.930372:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x17f:0x0].0x0 (ffff91604faeba00) 00010000:00010000:2.0:1769074925.930375:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074925.930378:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7400, rc 0) 00000100:00100000:2.0:1769074925.930475:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67497:x1855007616119680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2038us (2549us total) trans 4294969052 rc 0/0 00000100:00100000:2.0:1769074925.930486:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9487 00000100:00100000:3.0:1769074925.934978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.935153:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119808 00000100:00100000:1.0:1769074925.935167:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119808 00000100:00100000:1.0:1769074925.935239:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2739 00000100:00100000:1.0:1769074925.935251:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+172:2417:x1855007616119808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074925.935276:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074925.935313:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab35 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074925.935343:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074925.935368:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.935370:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074925.935381:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 173 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.935401:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 173 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074925.935419:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45200, rc 0) 00000100:00100000:1.0:1769074925.935496:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2417:x1855007616119808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 247us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074925.935504:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2739 00000100:00100000:3.0:1769074925.938690:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074925.938866:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616119936 00000100:00100000:0.0:1769074925.938880:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616119936 00000100:00100000:0.0:1769074925.938945:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2740 00000100:00100000:0.0:1769074925.938956:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:67497:x1855007616119936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074925.938980:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074925.939002:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab3c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.939041:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 174 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.939058:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.939060:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074925.939065:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab3c expref: 174 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.939108:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 174 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074925.939146:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 174 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074925.939164:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626625792:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074925.939293:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074925.946388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074925.946915:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120064 00000100:00100000:2.0:1769074925.946929:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120064 00010000:00010000:2.0:1769074925.947010:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074925.947067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1897 00000100:00100000:2.0:1769074925.947079:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2420:x1855007616120064:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074925.947100:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074925.947147:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074925.947165:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074925.947202:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.947205:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074925.947215:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab3c expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.947226:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab3c expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074925.947279:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab3c expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074925.947310:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626625920:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074925.947431:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47540 going to sleep for 11 seconds 00010000:00010000:0.0:1769074925.949070:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a45200/0x557988ac98fea63f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab35 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074925.949098:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626625792:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074925.949158:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49000/0x557988ac98fea646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab3c expref: 174 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074925.949173:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49000, rc 0) 00000100:00100000:0.0:1769074925.949253:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:67497:x1855007616119936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10297us (10575us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074925.949263:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2740 00000100:00100000:2.0:1769074925.955761:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626625920:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074925.955805:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074925.955887:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2420:x1855007616120064:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8808us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074925.955903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1897 00000100:00100000:3.0:1769074925.960145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074925.960347:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120320 00000100:00100000:1.0:1769074925.960361:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120320 00000100:00100000:1.0:1769074925.960437:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1882 00000100:00100000:1.0:1769074925.960450:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+344:67497:x1855007616120320:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074925.960904:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67497:x1855007616120320:12345-192.168.204.32@tcp:35:cp.0 Request processed in 455us (791us total) trans 4294969053 rc 0/0 00000100:00100000:1.0:1769074925.960914:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1882 00000100:00100000:3.0:1769074926.002799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.002923:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120448 00000100:00100000:2.0:1769074926.002936:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120448 00000100:00100000:2.0:1769074926.003020:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9488 00000100:00100000:2.0:1769074926.003032:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67501:x1855007616120448:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074926.003061:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.003091:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea64d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab43 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.003205:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074926.003224:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003238:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003254:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074926.003262:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003268:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003340:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003349:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003356:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003363:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.003367:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003376:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003390:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.003392:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.003398:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003402:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea654 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003418:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003424:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003430:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003434:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6aa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.003437:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003447:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003453:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604faebe00) 00010000:00010000:2.0:1769074926.003456:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.003458:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003464:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6aa00/0x557988ac98fea65b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074926.003502:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea64d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab43 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.003513:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.003516:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.003520:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea64d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab43 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.003611:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:2.0:1769074926.003724:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67501:x1855007616120448:12345-192.168.204.32@tcp:101:bash.0 Request processed in 694us (941us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.003733:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9488 00000100:00100000:1.0:1769074926.003951:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626626432:0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.004019:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626626048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769074926.004023:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074926.004054:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.004171:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626432 00000100:00100000:0.0:1769074926.004178:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626432 00000100:00100000:0.0:1769074926.004218:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1769074926.004226:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626626432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.004272:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626626432:12345-0@lo:400:kworker.0 Request processed in 46us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.004278:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1769074926.004319:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626626176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074926.004349:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.004375:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626176 00000100:00100000:0.0:1769074926.004379:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626176 00000100:00100000:0.0:1769074926.004401:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1769074926.004407:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1855007626626176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1769074926.004434:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:0.0:1769074926.004473:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1855007626626176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.004480:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1769074926.004510:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e86036b9-84bb-449e-baba-8ef95d66b0fb:3656:1855007626626304:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.004572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.004604:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626304 00000100:00100000:0.0:1769074926.004609:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626304 00000100:00100000:0.0:1769074926.004638:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1769074926.004644:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604361b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3656:x1855007626626304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.004679:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604361b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3656:x1855007626626304:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.004686:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1769074926.004843:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1855007626626560:0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.004873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074926.004898:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626048 00000100:00100000:3.0:1769074926.004903:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626048 00000100:00100000:3.0:1769074926.004947:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1769074926.004955:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1855007626626048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074926.004972:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2809856 granted 493366208 pending 86016 free 3915657216 avail 3684134912 00000100:00100000:3.0:1769074926.005007:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1855007626626048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.005014:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00080000:3.0:1769074926.005030:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769074926.005655:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626626176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074926.005665:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1855007626626688:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.005696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.005728:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1855007626627200:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.005758:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.005781:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626627712:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.005806:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.005855:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627712 00000100:00100000:0.0:1769074926.005859:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627712 00000100:00100000:0.0:1769074926.005899:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1769074926.005905:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626627712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.005940:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626627712:12345-0@lo:400:kworker.0 Request processed in 35us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.005946:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1769074926.005971:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626627712:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.005990:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626560 00000100:00100000:0.0:1769074926.005993:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626560 00000100:00100000:0.0:1769074926.006024:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626688 00000100:00100000:0.0:1769074926.006027:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626688 00000100:00100000:0.0:1769074926.006048:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627200 00000100:00100000:0.0:1769074926.006051:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627200 00000100:00100000:0.0:1769074926.006075:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:0.0:1769074926.006081:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1855007626626560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1769074926.006231:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1769074926.006235:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1769074926.006237:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074926.006261:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1855007626626560:0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006270:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626627072:0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006294:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074926.006310:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626627584:0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074926.006371:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626626048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074926.006392:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627072 00000100:00100000:3.0:1769074926.006395:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627072 00000100:00080000:3.0:1769074926.006411:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074926.006429:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:3.0:1769074926.006435:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1855007626626688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006468:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1855007626626688:12345-0@lo:400:kworker.0 Request processed in 33us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.006474:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:3.0:1769074926.006485:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:3.0:1769074926.006490:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1855007626627200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006512:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1855007626627200:12345-0@lo:400:kworker.0 Request processed in 22us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.006517:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:3.0:1769074926.006525:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:3.0:1769074926.006550:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626627072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.006578:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626627072:12345-0@lo:400:kworker.0 Request processed in 48us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.006584:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:3.0:1769074926.006602:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626627072:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.006731:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1855007626626560:12345-0@lo:400:kworker.0 Request processed in 36us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.006738:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:0.0:1769074926.006779:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1855007626626688:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.006788:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1855007626627200:0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.006805:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627584 00000100:00100000:0.0:1769074926.006808:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627584 00000100:00100000:0.0:1769074926.006843:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1769074926.006848:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626627584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074926.006880:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626627584:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.006886:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1769074926.006905:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626627584:0@lo:400:kworker.0 00000100:00080000:3.0:1769074926.007236:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074926.007354:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e86036b9-84bb-449e-baba-8ef95d66b0fb:3656:1855007626626304:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007364:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1855007626626816:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007402:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007433:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626627328:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007461:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007478:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1855007626627840:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007510:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007548:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1769074926.007555:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626626944:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007575:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007588:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626627456:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007624:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626627968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1769074926.007640:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.007665:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627456 00000100:00100000:2.0:1769074926.007669:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627456 00000100:00100000:2.0:1769074926.007695:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627968 00000100:00100000:2.0:1769074926.007697:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627968 00000100:00100000:2.0:1769074926.007707:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1769074926.007713:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1855007626627456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074926.007852:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626626432:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.007936:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1855007626627456:12345-0@lo:400:kworker.0 Request processed in 222us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.007943:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1769074926.007958:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1769074926.007964:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626627968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1769074926.007991:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446215680 avail 1299976192 00000100:00100000:2.0:1769074926.008023:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626627968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.008029:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1769074926.008059:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626627456:0@lo:400:kworker.0 00000100:00100000:2.0:1769074926.008074:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626627968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074926.008182:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626816 00000100:00100000:1.0:1769074926.008187:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626816 00000100:00100000:1.0:1769074926.008238:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627840 00000100:00100000:1.0:1769074926.008241:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627840 00000100:00100000:1.0:1769074926.008262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1769074926.008268:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1855007626626816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008306:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1855007626626816:12345-0@lo:400:kworker.0 Request processed in 38us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.008312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1769074926.008323:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1769074926.008329:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1855007626627840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008359:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1855007626627840:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.008364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1769074926.008385:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626627328 00000100:00100000:1.0:1769074926.008388:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626627328 00000100:00100000:1.0:1769074926.008417:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626626944 00000100:00100000:1.0:1769074926.008420:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626626944 00000100:00100000:1.0:1769074926.008440:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1769074926.008446:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626627328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008477:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626627328:12345-0@lo:400:kworker.0 Request processed in 32us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.008483:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1769074926.008506:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1769074926.008512:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626626944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008555:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1855007626626944:12345-0@lo:400:kworker.0 Request processed in 44us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.008561:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1769074926.008591:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626626944:0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008601:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1855007626626816:0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008609:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626627328:0@lo:400:kworker.0 00000100:00100000:1.0:1769074926.008617:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1855007626627840:0@lo:400:kworker.0 00000100:00080000:3.0:1769074926.008960:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1769074926.008965:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074926.017427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.018756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.018958:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120704 00000100:00100000:0.0:1769074926.018972:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120704 00000100:00100000:0.0:1769074926.019051:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 191 00000100:00100000:0.0:1769074926.019060:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2419:x1855007616120704:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074926.019110:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.019153:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea662 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab51 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.019220:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074926.019239:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019252:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019267:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074926.019275:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019281:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019361:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019368:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019375:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019381:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.019385:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019392:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019406:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.019409:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.019414:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019420:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea669 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019435:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019442:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019449:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019454:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.019457:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019462:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019469:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916174963b00) 00010000:00010000:0.0:1769074926.019472:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.019474:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019480:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea670 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.019511:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea662 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab51 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.019522:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.019524:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074926.019568:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49200/0x557988ac98fea662 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab51 expref: 346 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.019579:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49200, rc -2) 00000100:00100000:0.0:1769074926.019661:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:2419:x1855007616120704:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 600us (918us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074926.019671:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 191 00000100:00100000:2.0:1769074926.020759:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120576 00000100:00100000:2.0:1769074926.020773:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120576 00000100:00100000:3.0:1769074926.020901:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9489 00000100:00100000:3.0:1769074926.020912:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67502:x1855007616120576:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074926.020933:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.020956:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea677 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.021031:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.021047:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021057:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021074:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.021081:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021086:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021166:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021174:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021181:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021187:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.021191:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021199:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021212:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.021215:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.021219:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021224:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea67e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021235:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021241:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021246:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021251:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.021254:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021264:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021271:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f135200) 00010000:00010000:3.0:1769074926.021273:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.021276:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea685 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.021319:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea677 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab4a expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.021327:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.021330:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.021333:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea677 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab4a expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.021341:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074926.021410:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67502:x1855007616120576:12345-192.168.204.32@tcp:101:rm.0 Request processed in 499us (3999us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.021418:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9489 00000100:00100000:3.0:1769074926.026882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.027131:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120832 00000100:00100000:1.0:1769074926.027158:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120832 00000100:00100000:1.0:1769074926.027239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9490 00000100:00100000:1.0:1769074926.027252:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67502:x1855007616120832:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074926.027282:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.027310:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea68c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.027403:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074926.027433:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027455:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027500:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:1.0:1769074926.027509:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027516:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027791:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027800:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027808:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027814:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.027819:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027832:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027848:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.027851:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.027858:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027864:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea693 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027880:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027885:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027891:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027895:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.027898:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027904:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027911:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604e2b2100) 00010000:00010000:1.0:1769074926.027913:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.027915:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027919:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea69a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:1.0:1769074926.027951:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea68c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab58 expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.027959:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.027961:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.027963:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea68c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab58 expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.027970:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45600, rc 0) 00000100:00100000:1.0:1769074926.028421:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67502:x1855007616120832:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1162us (1545us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.028428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9490 00000100:00100000:1.0:1769074926.048822:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.048897:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616120960 00000100:00100000:3.0:1769074926.048912:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616120960 00000100:00100000:3.0:1769074926.049054:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9491 00000100:00100000:3.0:1769074926.049067:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67503:x1855007616120960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.049099:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.049150:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea6a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.049279:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.049308:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049324:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049344:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.049351:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049358:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049428:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049436:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049443:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049450:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.049454:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049465:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049480:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.049483:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.049489:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea6a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049526:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049591:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049596:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049601:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.049604:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049610:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049618:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f135200) 00010000:00010000:3.0:1769074926.049621:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.049624:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049630:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea6af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.049669:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea6a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab5f expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.049680:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.049683:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.049686:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea6a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab5f expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.049696:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246e00, rc 0) 00000100:00100000:3.0:1769074926.049794:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67503:x1855007616120960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 729us (987us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.049803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9491 00000100:00100000:0.0:1769074926.053911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.054055:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121088 00000100:00100000:3.0:1769074926.054069:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121088 00000100:00100000:3.0:1769074926.054163:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9492 00000100:00100000:3.0:1769074926.054175:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67503:x1855007616121088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.054202:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.054232:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea6b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.054335:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.054355:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054369:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054393:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.054400:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054407:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054477:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054485:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054506:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054513:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.054517:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054525:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054704:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.054708:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.054715:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054721:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea6bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054737:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054868:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054878:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054883:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.054887:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054894:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054903:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff91604f135800) 00010000:00010000:3.0:1769074926.054906:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.054909:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054916:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.054956:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea6b6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab66 expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.054967:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.054970:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.054974:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea6b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab66 expref: 346 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.054983:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:3.0:1769074926.055128:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67503:x1855007616121088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 953us (1232us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.055148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9492 00000100:00100000:2.0:1769074926.059711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.060024:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121344 00000100:00100000:0.0:1769074926.060038:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121344 00000100:00100000:0.0:1769074926.060122:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9493 00000100:00100000:0.0:1769074926.060143:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+345:67503:x1855007616121344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.060172:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.060200:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea6cb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab6d expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.060383:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074926.060402:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.060415:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.060432:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf217f355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074926.060439:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.060445:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074926.060898:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xbb:0x0], index 0: 0 00010000:00010000:0.0:1769074926.061090:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48200/0x557988ac98fea6e0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x180:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074926.061101:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48200/0x557988ac98fea6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061114:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48200/0x557988ac98fea6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061170:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061178:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061183:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061189:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061196:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.061200:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061208:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061223:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.061227:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.061233:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061239:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea6d2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074926.061256:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b39d238 reply state 00000000b3680f0b transno 4294969054 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061268:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074926.061275:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff916174963b00) 00010000:00010000:0.0:1769074926.061277:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074926.061282:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074926.061320:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea6cb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab6d expref: 348 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.061337:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48200/0x557988ac98fea6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab6d expref: 347 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.061345:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x180:0x0].0x0 (ffff916174963c00) 00010000:00010000:0.0:1769074926.061348:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074926.061351:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48200, rc 0) 00000100:00100000:0.0:1769074926.061451:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+348:67503:x1855007616121344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1316us (1755us total) trans 4294969054 rc 0/0 00000100:00100000:0.0:1769074926.061461:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9493 00000100:00100000:2.0:1769074926.065956:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.066241:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121472 00000100:00100000:0.0:1769074926.066527:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121472 00000100:00100000:0.0:1769074926.066770:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2741 00000100:00100000:0.0:1769074926.066782:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+172:2417:x1855007616121472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.066807:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.066836:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab74 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074926.066867:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074926.066896:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.066898:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.066910:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 173 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.066931:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 173 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.066945:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48e00, rc 0) 00000100:00100000:0.0:1769074926.067029:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2417:x1855007616121472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 249us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.067038:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2741 00000100:00100000:2.0:1769074926.071912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.071997:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121600 00000100:00100000:0.0:1769074926.072012:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121600 00000100:00100000:0.0:1769074926.072087:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2742 00000100:00100000:0.0:1769074926.072099:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:67503:x1855007616121600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.072145:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.072171:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab7b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.072213:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.072223:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.072225:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.072230:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab7b expref: 174 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.072274:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.072310:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074926.072328:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626628096:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074926.072471:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384180 going to sleep for 11 seconds 00000100:00100000:0.0:1769074926.076281:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626628096:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074926.076344:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab7b expref: 174 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.076371:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49200, rc 0) 00000100:00100000:0.0:1769074926.076464:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:67503:x1855007616121600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4365us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.076474:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2742 00000100:00100000:1.0:1769074926.078019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.078182:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121728 00000100:00100000:2.0:1769074926.078194:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121728 00010000:00010000:2.0:1769074926.078270:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074926.078327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1898 00000100:00100000:2.0:1769074926.078338:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2420:x1855007616121728:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074926.078357:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074926.078383:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.078401:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.078429:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98fea6ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab74 expref: 174 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.078448:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.078450:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.078459:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab7b expref: 173 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.078474:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab7b expref: 173 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.078589:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a49200/0x557988ac98fea6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab7b expref: 173 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074926.078608:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b57ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626628224:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074926.078724:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47540 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.083229:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b57ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626628224:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074926.083274:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074926.083367:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2420:x1855007616121728:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5028us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.083380:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1898 00000100:00100000:3.0:1769074926.086910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.087050:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616121984 00000100:00100000:0.0:1769074926.087066:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616121984 00000100:00100000:0.0:1769074926.087152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1883 00000100:00100000:0.0:1769074926.087164:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+348:67503:x1855007616121984:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074926.087638:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67503:x1855007616121984:12345-192.168.204.32@tcp:35:cp.0 Request processed in 474us (743us total) trans 4294969055 rc 0/0 00000100:00100000:0.0:1769074926.087647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1883 00000100:00100000:1.0:1769074926.123197:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.123317:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122112 00000100:00100000:3.0:1769074926.123332:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122112 00000100:00100000:3.0:1769074926.123412:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9494 00000100:00100000:3.0:1769074926.123424:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67506:x1855007616122112:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074926.123451:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.123478:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.124036:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.124056:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124071:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124088:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.124095:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124105:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124193:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124200:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124207:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124213:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.124218:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124226:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124239:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.124244:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.124250:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124256:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea703 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124271:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124277:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124283:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124289:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604de04000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.124292:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124298:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124306:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f135800) 00010000:00010000:3.0:1769074926.124308:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.124311:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124316:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea70a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.124359:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab82 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.124370:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.124373:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.124377:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea6fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab82 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.124386:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f989800, rc 0) 00000100:00100000:3.0:1769074926.124475:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67506:x1855007616122112:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1053us (1295us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.124484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9494 00000100:00100000:2.0:1769074926.141016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.141068:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.141304:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122240 00000100:00100000:3.0:1769074926.141318:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122240 00000100:00100000:3.0:1769074926.141399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9495 00000100:00100000:3.0:1769074926.141411:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67507:x1855007616122240:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074926.141447:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.141476:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea711 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.141614:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.141634:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141648:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141664:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.141671:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141678:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141942:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141951:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141959:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141966:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.141972:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141981:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.141996:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.141999:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.142005:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142012:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98fea718 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142027:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142033:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142037:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142042:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.142045:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142051:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142059:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f135800) 00010000:00010000:3.0:1769074926.142062:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.142064:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142075:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98fea71f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.142114:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea711 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab89 expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.142124:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.142127:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.142130:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea711 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab89 expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.142150:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:3.0:1769074926.142227:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67507:x1855007616122240:12345-192.168.204.32@tcp:101:rm.0 Request processed in 817us (1226us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.142236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9495 00000100:00100000:0.0:1769074926.142736:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122368 00000100:00100000:0.0:1769074926.142756:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122368 00000100:00100000:0.0:1769074926.142808:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 192 00000100:00100000:0.0:1769074926.142817:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2418:x1855007616122368:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074926.142874:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.142889:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea726 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ab90 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.142934:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.142946:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.142955:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.142968:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.142974:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.142980:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143022:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143029:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143035:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143040:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.143044:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143054:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143064:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.143067:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.143070:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143076:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea72d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143087:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143092:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143097:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143102:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.143104:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143110:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143117:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff916174963a00) 00010000:00010000:0.0:1769074926.143119:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.143122:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143127:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea734 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.143163:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea726 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab90 expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.143171:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.143174:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074926.143177:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea726 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ab90 expref: 350 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.143187:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc -2) 00000100:00100000:0.0:1769074926.143250:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2418:x1855007616122368:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 433us (2180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074926.143258:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 192 00000100:00100000:1.0:1769074926.147470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.147738:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122496 00000100:00100000:3.0:1769074926.147760:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122496 00000100:00100000:3.0:1769074926.147830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9496 00000100:00100000:3.0:1769074926.147840:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67507:x1855007616122496:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074926.147866:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.147893:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea73b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2abc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.147972:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.147990:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148007:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148023:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.148029:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148035:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148102:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148110:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148116:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148122:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.148127:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148145:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148159:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.148162:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.148168:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148174:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea742 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148190:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148196:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148201:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148206:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.148209:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148215:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148222:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f135200) 00010000:00010000:3.0:1769074926.148224:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.148227:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea749 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.148267:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea73b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abc8 expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.148278:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.148280:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.148284:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98fea73b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abc8 expref: 350 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.148298:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074926.148374:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67507:x1855007616122496:12345-192.168.204.32@tcp:101:rm.0 Request processed in 535us (921us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.148382:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9496 00000100:00100000:3.0:1769074926.169420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.171442:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.171636:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122752 00000100:00100000:0.0:1769074926.171650:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122752 00000100:00100000:0.0:1769074926.171730:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:0.0:1769074926.171741:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2419:x1855007616122752:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074926.171822:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.171851:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea750 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2abd6 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.171930:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074926.171949:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.171962:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.171984:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074926.171991:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.171997:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172063:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172071:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172078:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172084:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.172088:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172096:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172110:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.172114:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.172120:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172125:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea757 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172152:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172159:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172165:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172170:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.172172:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172178:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172185:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff916174963a00) 00010000:00010000:0.0:1769074926.172188:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.172191:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172197:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea75e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074926.172230:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea750 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abd6 expref: 350 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.172240:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.172243:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074926.172247:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea750 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abd6 expref: 350 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.172257:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc -2) 00000100:00100000:0.0:1769074926.172349:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:2419:x1855007616122752:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 609us (918us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074926.172358:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:1.0:1769074926.174907:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122624 00000100:00100000:1.0:1769074926.174925:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122624 00000100:00100000:1.0:1769074926.175051:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9497 00000100:00100000:1.0:1769074926.175064:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67510:x1855007616122624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.175090:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.175117:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea765 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2abcf expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.175214:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.175232:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175246:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175263:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.175271:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175277:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175346:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175355:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175361:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175368:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175374:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.175379:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175388:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175402:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.175405:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.175410:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175417:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98fea76c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175433:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175439:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175445:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175450:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.175453:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175459:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175465:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604e2b2100) 00010000:00010000:1.0:1769074926.175467:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.175469:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175474:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea773 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.175523:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea765 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abcf expref: 350 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.175560:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.175563:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.175567:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea765 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2abcf expref: 350 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.175576:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc 0) 00000100:00100000:1.0:1769074926.175672:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67510:x1855007616122624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 609us (6267us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.175682:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9497 00000100:00100000:2.0:1769074926.179335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.179436:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616122880 00000100:00100000:1.0:1769074926.179450:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616122880 00000100:00100000:1.0:1769074926.179565:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9498 00000100:00100000:1.0:1769074926.179577:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67510:x1855007616122880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.179605:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.179633:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea77a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac0e expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.179715:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.179732:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179757:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179772:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.179779:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179785:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179849:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179856:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179862:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179868:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179874:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.179878:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179886:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179899:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.179902:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.179906:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179912:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea781 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179929:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179935:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179940:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179946:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.179949:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179954:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179960:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604e2b2d00) 00010000:00010000:1.0:1769074926.179962:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.179964:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.179969:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea788 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.180014:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea77a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac0e expref: 350 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.180024:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.180026:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.180029:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea77a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac0e expref: 350 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.180037:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45600, rc 0) 00000100:00100000:1.0:1769074926.180125:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67510:x1855007616122880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 549us (804us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.180142:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9498 00000100:00100000:2.0:1769074926.186412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.186841:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123136 00000100:00100000:3.0:1769074926.186857:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123136 00000100:00100000:3.0:1769074926.186940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9499 00000100:00100000:3.0:1769074926.186952:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+349:67510:x1855007616123136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.186980:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.187009:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea78f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac15 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.187180:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.187199:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.187212:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.187231:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x6b471171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:3.0:1769074926.187238:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074926.187245:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00000004:00080000:2.0:1769074926.189486:0:6518:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xbc:0x0], index 1: 0 00010000:00010000:2.0:1769074926.190067:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea7a4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074926.190088:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190102:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190165:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190173:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190186:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190192:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.190197:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190204:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190220:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.190223:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.190229:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190235:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea796 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00000004:00010000:2.0:1769074926.190253:0:6518:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed269907 reply state 00000000b7ff1c27 transno 4294969056 ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190266:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.190272:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f135200) 00010000:00010000:2.0:1769074926.190274:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074926.190278:0:6518:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074926.190427:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea78f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac15 expref: 352 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.190445:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a800/0x557988ac98fea7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac15 expref: 351 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.190458:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x181:0x0].0x0 (ffff91604faebe00) 00010000:00010000:2.0:1769074926.190461:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074926.190464:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a800, rc 0) 00000100:00100000:2.0:1769074926.190932:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67510:x1855007616123136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3979us (4535us total) trans 4294969056 rc 0/0 00000100:00100000:2.0:1769074926.190943:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9499 00000100:00100000:2.0:1769074926.194619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.194950:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123264 00000100:00100000:1.0:1769074926.194964:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123264 00000100:00100000:1.0:1769074926.195040:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2743 00000100:00100000:1.0:1769074926.195051:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2418:x1855007616123264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.195075:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.195100:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac1c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074926.195129:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074926.195165:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.195168:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.195178:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 174 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.195198:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 174 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.195213:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074926.195293:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2418:x1855007616123264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 243us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.195301:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2743 00000100:00100000:1.0:1769074926.199590:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.199972:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123392 00000100:00100000:2.0:1769074926.199987:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123392 00000100:00100000:2.0:1769074926.200061:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2744 00000100:00100000:2.0:1769074926.200073:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:67510:x1855007616123392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.200097:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.200123:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac23 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.200174:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 175 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.200185:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.200187:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.200192:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac23 expref: 175 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.200236:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 175 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.200259:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 175 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074926.200277:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626628352:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074926.200716:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.204004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.204122:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123520 00000100:00100000:0.0:1769074926.204144:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123520 00010000:00010000:0.0:1769074926.204219:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 176 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074926.204272:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1899 00000100:00100000:0.0:1769074926.204285:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2419:x1855007616123520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074926.204315:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074926.204341:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 176 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.204357:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 176 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.204389:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.204392:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.204401:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac23 expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.204413:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac23 expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.204461:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac23 expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074926.204478:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626628480:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074926.204641:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453849c0 going to sleep for 11 seconds 00010000:00010000:2.0:1769074926.205349:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a44e00/0x557988ac98fea7b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac1c expref: 176 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074926.205379:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626628352:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074926.205414:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916044c6aa00/0x557988ac98fea7b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac23 expref: 175 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.205427:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6aa00, rc 0) 00000100:00100000:2.0:1769074926.205483:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:67510:x1855007616123392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5412us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.205493:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2744 00000100:00100000:3.0:1769074926.211247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.211365:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123776 00000100:00100000:1.0:1769074926.211379:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123776 00000100:00100000:1.0:1769074926.211459:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1884 00000100:00100000:1.0:1769074926.211471:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+352:67510:x1855007616123776:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074926.211958:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67510:x1855007616123776:12345-192.168.204.32@tcp:35:cp.0 Request processed in 487us (726us total) trans 4294969057 rc 0/0 00000100:00100000:1.0:1769074926.211968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1884 00000100:00100000:0.0:1769074926.212830:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626628480:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074926.212862:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074926.212911:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2419:x1855007616123520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8628us (8921us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.212922:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1899 00000100:00100000:3.0:1769074926.241378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.241524:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616123904 00000100:00100000:2.0:1769074926.241589:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616123904 00000100:00100000:2.0:1769074926.241652:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 194 00000100:00100000:2.0:1769074926.241662:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616123904:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074926.241736:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.241777:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea7c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac2a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.241864:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.241884:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.241897:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.241914:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.241921:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.241928:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242005:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242013:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242020:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242026:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.242032:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242040:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242058:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.242062:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.242068:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242074:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea7c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242089:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242095:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242100:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242105:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.242108:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242114:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242122:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604faebf00) 00010000:00010000:2.0:1769074926.242124:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.242127:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242143:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea7ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.242181:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea7c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac2a expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.242192:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.242195:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074926.242198:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea7c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac2a expref: 354 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.242208:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc -2) 00000100:00100000:2.0:1769074926.242297:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616123904:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 635us (936us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074926.242307:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 194 00000100:00100000:3.0:1769074926.255094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.256283:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124032 00000100:00100000:2.0:1769074926.256392:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124032 00000100:00100000:2.0:1769074926.256888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9500 00000100:00100000:2.0:1769074926.256904:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67517:x1855007616124032:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074926.256932:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.256964:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea7d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac62 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.257055:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074926.257073:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257088:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257106:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 00010000:00010000:2.0:1769074926.257119:0:6518:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257125:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257207:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257216:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257223:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257230:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.257235:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257244:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.257262:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.257268:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257275:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea7dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257290:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257473:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257480:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.257485:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71f800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.257488:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.258100:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.258114:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604faeb800) 00010000:00010000:2.0:1769074926.258117:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.258120:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.258126:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea7e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:2.0:1769074926.258191:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea7d5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac62 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.258202:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.258205:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.258209:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea7d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac62 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.258219:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:2.0:1769074926.258411:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67517:x1855007616124032:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1509us (3330us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.258421:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9500 00000100:00100000:3.0:1769074926.266600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.268453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.271668:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124160 00000100:00100000:1.0:1769074926.271695:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124160 00000100:00100000:1.0:1769074926.271819:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9501 00000100:00100000:1.0:1769074926.271831:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67518:x1855007616124160:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074926.271859:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.271888:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea7ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac69 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.272002:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.272022:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272035:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272052:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.272059:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272065:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272924:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272939:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272946:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272958:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272965:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.272969:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.272977:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273060:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.273063:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.273070:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273077:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98fea7f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273103:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273244:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273252:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273257:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.273261:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273267:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273280:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604e2b2b00) 00010000:00010000:1.0:1769074926.273283:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.273286:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273292:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98fea7f8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.273342:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea7ea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac69 expref: 354 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.273353:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.273355:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.273359:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98fea7ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac69 expref: 354 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.273369:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc 0) 00000100:00100000:1.0:1769074926.273567:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67518:x1855007616124160:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1735us (6979us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.273576:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9501 00000100:00100000:1.0:1769074926.273793:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124288 00000100:00100000:1.0:1769074926.273801:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124288 00000100:00100000:1.0:1769074926.273850:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:1.0:1769074926.273858:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616124288:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074926.273893:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.273908:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea7ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac70 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.273966:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074926.273978:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.273987:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274086:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074926.274094:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274101:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274302:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274310:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274317:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274322:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.274326:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274526:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274581:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.274584:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.274588:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274595:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98fea806 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274608:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274613:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274619:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274624:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.274626:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274632:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274637:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff91604e2b2c00) 00010000:00010000:1.0:1769074926.274639:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.274642:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274646:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea80d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074926.274682:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea7ff lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac70 expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.274691:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.274693:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074926.274697:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea7ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac70 expref: 354 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.274704:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45200, rc -2) 00000100:00100000:1.0:1769074926.274767:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:2419:x1855007616124288:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 909us (6327us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074926.274774:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:1.0:1769074926.281650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.282094:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124416 00000100:00100000:1.0:1769074926.282109:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124416 00000100:00100000:1.0:1769074926.282440:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9502 00000100:00100000:1.0:1769074926.282453:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67518:x1855007616124416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074926.282485:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.282513:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea814 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac77 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.282633:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.282651:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282664:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282682:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074926.282690:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282696:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282773:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282782:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282788:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282795:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282801:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.282806:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282814:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282829:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.282832:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.282838:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282845:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea81b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282864:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282871:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282876:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282881:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.282884:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282889:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282895:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.282898:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.282900:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282905:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea822 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074926.282946:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea814 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac77 expref: 354 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.282957:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.282959:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.282964:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea814 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac77 expref: 354 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.282984:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:1.0:1769074926.283061:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67518:x1855007616124416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 611us (1427us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.283070:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9502 00000100:00100000:1.0:1769074926.303456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.303872:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124544 00000100:00100000:0.0:1769074926.303887:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124544 00000100:00100000:0.0:1769074926.303970:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9503 00000100:00100000:0.0:1769074926.303987:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67519:x1855007616124544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.304016:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.304043:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea829 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac7e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.304167:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074926.304186:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304200:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304215:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074926.304222:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304228:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304303:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304311:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304318:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304324:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.304329:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304337:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304349:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.304353:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.304357:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304363:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fea830 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304377:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304382:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304388:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304393:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.304396:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304402:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304408:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff916174963a00) 00010000:00010000:0.0:1769074926.304411:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.304413:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304418:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49400/0x557988ac98fea837 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074926.304452:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea829 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac7e expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.304462:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.304464:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.304468:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98fea829 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac7e expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.304478:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc 0) 00000100:00100000:0.0:1769074926.305631:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67519:x1855007616124544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1636us (2176us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074926.305644:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9503 00000100:00100000:1.0:1769074926.309402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.309924:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124672 00000100:00100000:0.0:1769074926.309942:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124672 00000100:00100000:2.0:1769074926.310162:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9504 00000100:00100000:2.0:1769074926.310175:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67519:x1855007616124672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.310210:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.310241:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea83e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac85 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.310339:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.310359:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310374:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310386:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.310391:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310394:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310464:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310469:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310473:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310478:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.310483:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310489:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310511:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.310515:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.310521:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310527:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea845 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310714:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310718:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310722:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310724:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.310726:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310730:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310735:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604faeb800) 00010000:00010000:2.0:1769074926.310736:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.310738:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310747:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea84c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.310792:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea83e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac85 expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.310804:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.310807:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.310810:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71f800/0x557988ac98fea83e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac85 expref: 354 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.310819:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f800, rc 0) 00000100:00100000:2.0:1769074926.310914:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67519:x1855007616124672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 742us (1527us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.310923:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9504 00000100:00100000:1.0:1769074926.314280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.315646:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616124928 00000100:00100000:2.0:1769074926.315662:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616124928 00000100:00100000:2.0:1769074926.315743:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9505 00000100:00100000:2.0:1769074926.315757:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+353:67519:x1855007616124928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.315785:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.315814:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea853 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac8c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.315959:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.315974:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.316113:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.316146:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.316155:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.316163:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074926.318783:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xbc:0x0], index 0: 0 00010000:00010000:3.0:1769074926.319065:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea868 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x182:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.319085:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea868 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319100:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea868 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319172:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319179:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319186:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319193:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.319199:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319207:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319226:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.319230:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.319236:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319242:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea85a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074926.319257:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ad5332de reply state 000000009daef781 transno 4294969058 ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319269:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.319275:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604faebf00) 00010000:00010000:3.0:1769074926.319277:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074926.319281:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074926.319338:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea853 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac8c expref: 356 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.319354:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604de04000/0x557988ac98fea868 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac8c expref: 355 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.319361:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x182:0x0].0x0 (ffff91604f135800) 00010000:00010000:3.0:1769074926.319363:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074926.319366:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604de04000, rc 0) 00000100:00100000:3.0:1769074926.319465:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67519:x1855007616124928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3710us (5199us total) trans 4294969058 rc 0/0 00000100:00100000:3.0:1769074926.319476:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9505 00000100:00100000:1.0:1769074926.325912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.326039:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125056 00000100:00100000:2.0:1769074926.326055:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125056 00000100:00100000:2.0:1769074926.326430:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2745 00000100:00100000:2.0:1769074926.326443:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+173:2418:x1855007616125056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.326469:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.326510:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac93 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074926.326589:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074926.326619:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.326621:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.326632:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 174 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.326653:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 174 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.326675:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e600, rc 0) 00000100:00100000:2.0:1769074926.326771:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2418:x1855007616125056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 331us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.326780:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2745 00000100:00100000:1.0:1769074926.333843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.334027:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125184 00000100:00100000:2.0:1769074926.334040:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125184 00000100:00100000:2.0:1769074926.334125:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2746 00000100:00100000:2.0:1769074926.334147:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:67519:x1855007616125184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.334174:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.334198:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ac9a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.334239:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.334248:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.334250:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.334255:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac9a expref: 175 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.334309:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.334326:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074926.334348:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626628608:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074926.334911:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.344705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.344972:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626628608:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074926.345017:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac9a expref: 175 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.345045:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71f800, rc 0) 00000100:00100000:2.0:1769074926.345143:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:67519:x1855007616125184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10997us (11315us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.345155:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2746 00000100:00100000:0.0:1769074926.345917:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125312 00000100:00100000:0.0:1769074926.345929:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125312 00010000:00010000:0.0:1769074926.345998:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074926.346043:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1900 00000100:00100000:0.0:1769074926.346054:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2420:x1855007616125312:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074926.346071:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074926.346099:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.346128:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.346168:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e71e600/0x557988ac98fea876 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac93 expref: 175 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.346186:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.346188:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.346197:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac9a expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.346209:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac9a expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.346251:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e71f800/0x557988ac98fea87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ac9a expref: 174 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074926.346268:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626628736:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074926.346765:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074926.352914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.353020:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125568 00000100:00100000:2.0:1769074926.353032:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125568 00000100:00100000:2.0:1769074926.353105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1885 00000100:00100000:2.0:1769074926.353127:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:67519:x1855007616125568:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074926.353595:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67519:x1855007616125568:12345-192.168.204.32@tcp:35:cp.0 Request processed in 469us (695us total) trans 4294969059 rc 0/0 00000100:00100000:2.0:1769074926.353605:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1885 00000100:00100000:0.0:1769074926.355021:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626628736:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074926.355056:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074926.355330:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2420:x1855007616125312:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9276us (10637us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.355343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1900 00000100:00100000:1.0:1769074926.392102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.392320:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125696 00000100:00100000:3.0:1769074926.392335:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125696 00000100:00100000:3.0:1769074926.392422:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9506 00000100:00100000:3.0:1769074926.392434:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67522:x1855007616125696:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074926.392463:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.392506:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea884 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aca1 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.392647:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.392667:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392681:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392699:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.392707:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392714:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392783:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392791:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392798:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392804:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.392810:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392819:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392832:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.392837:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.392843:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392850:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea88b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392876:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392884:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392889:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392895:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.392898:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392904:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392912:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604f135c00) 00010000:00010000:3.0:1769074926.392914:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.392918:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392923:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea892 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.392963:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea884 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aca1 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.392974:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.392977:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.392980:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fea884 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aca1 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.392990:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074926.393075:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67522:x1855007616125696:12345-192.168.204.32@tcp:101:bash.0 Request processed in 643us (989us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.393084:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9506 00000100:00100000:1.0:1769074926.406894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.407090:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125952 00000100:00100000:2.0:1769074926.407105:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125952 00000100:00100000:2.0:1769074926.407203:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 196 00000100:00100000:2.0:1769074926.407215:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2417:x1855007616125952:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074926.407280:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.407309:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea899 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acaf expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.407385:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.407403:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407415:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407432:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.407439:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407444:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407693:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407702:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407710:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407716:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.407721:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407734:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407931:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.407934:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.407941:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407948:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407965:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407971:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407977:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407982:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.407985:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407991:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.407999:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604faebc00) 00010000:00010000:2.0:1769074926.408001:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.408004:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.408010:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.408047:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea899 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acaf expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.408058:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.408061:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074926.408065:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea899 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acaf expref: 358 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.408076:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc -2) 00000100:00100000:2.0:1769074926.408415:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:2417:x1855007616125952:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1200us (1535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074926.408425:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 196 00000100:00100000:3.0:1769074926.411867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.416055:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616125824 00000100:00100000:2.0:1769074926.416082:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616125824 00000100:00100000:2.0:1769074926.416426:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9507 00000100:00100000:2.0:1769074926.416440:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67523:x1855007616125824:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.416468:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.416515:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea8ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aca8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.416689:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.416708:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416724:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416881:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.416890:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416897:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416969:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416977:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416983:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.416990:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.416995:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417003:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417018:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.417021:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.417026:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417032:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98fea8b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417051:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417058:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417064:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417068:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.417071:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417077:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604faebb00) 00010000:00010000:2.0:1769074926.417086:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.417089:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417095:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8bc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.417392:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea8ae lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aca8 expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.417406:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.417409:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.417413:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98fea8ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aca8 expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.417424:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246e00, rc 0) 00000100:00100000:2.0:1769074926.417737:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67523:x1855007616125824:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1299us (5886us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.417758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9507 00000100:00100000:3.0:1769074926.421987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.422091:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126080 00000100:00100000:2.0:1769074926.422105:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126080 00000100:00100000:2.0:1769074926.422320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9508 00000100:00100000:2.0:1769074926.422331:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67523:x1855007616126080:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.422360:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.422387:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea8c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acb6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.422480:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.422863:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.422881:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.422903:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.422910:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.422917:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423770:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423783:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423792:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423798:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.423802:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423810:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423827:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.423830:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.423836:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423842:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea8ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423858:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423864:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423869:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423874:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.423877:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423883:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423893:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604faebc00) 00010000:00010000:2.0:1769074926.423896:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.423899:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423904:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea8d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.423955:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea8c3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acb6 expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.423966:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.423968:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.423972:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea8c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acb6 expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.423982:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074926.424086:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67523:x1855007616126080:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1755us (2112us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.424097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9508 00000100:00100000:1.0:1769074926.438421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.438672:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126208 00000100:00100000:2.0:1769074926.438686:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126208 00000100:00100000:2.0:1769074926.438770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9509 00000100:00100000:2.0:1769074926.438783:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67524:x1855007616126208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.438811:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.438841:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.438934:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.438954:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.438967:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.438988:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.438996:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439003:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439075:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439082:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439090:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439096:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.439101:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439196:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439217:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.439221:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.439227:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea8df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439250:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439256:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439262:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439267:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.439270:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439276:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439283:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604faebb00) 00010000:00010000:2.0:1769074926.439286:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.439375:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439383:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea8e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.439426:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8d8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acbd expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.439438:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.439440:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.439444:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea8d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acbd expref: 358 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.439454:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e600, rc 0) 00000100:00100000:2.0:1769074926.439774:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67524:x1855007616126208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 992us (1369us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.439783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9509 00000100:00100000:1.0:1769074926.443829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.444031:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126336 00000100:00100000:3.0:1769074926.444044:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126336 00000100:00100000:3.0:1769074926.444120:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9510 00000100:00100000:3.0:1769074926.444142:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67524:x1855007616126336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.444168:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.444195:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea8ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acc4 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.444295:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.444320:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444334:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444349:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.444356:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444363:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444428:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444435:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444442:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444450:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.444455:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444464:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444476:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.444480:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.444485:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444502:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea8f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444516:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444522:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444582:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444588:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.444591:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444597:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444604:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604f135c00) 00010000:00010000:3.0:1769074926.444606:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.444609:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444615:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea8fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.444661:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea8ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acc4 expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.444671:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.444674:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.444677:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea8ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acc4 expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.444687:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:3.0:1769074926.444773:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67524:x1855007616126336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 643us (956us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.444780:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9510 00000100:00100000:1.0:1769074926.454784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.454899:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126592 00000100:00100000:2.0:1769074926.454913:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126592 00000100:00100000:2.0:1769074926.454990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9511 00000100:00100000:2.0:1769074926.455003:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67524:x1855007616126592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.455032:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.455059:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea902 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2accb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.455237:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.455256:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.455269:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.455285:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x16681c55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.455308:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.455315:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:2.0:1769074926.455767:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xbd:0x0], index 1: 0 00010000:00010000:2.0:1769074926.455966:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea917 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x183:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.455978:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea917 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.455986:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea917 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456026:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456034:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456041:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456048:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.456053:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456062:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456077:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.456081:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.456087:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456093:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea909 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:2.0:1769074926.456107:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000083c28fe5 reply state 000000001927d2af transno 4294969060 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456119:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.456125:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604faebb00) 00010000:00010000:2.0:1769074926.456137:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074926.456140:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074926.456182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea902 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2accb expref: 360 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.456200:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e600/0x557988ac98fea917 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2accb expref: 359 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.456208:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x183:0x0].0x0 (ffff91604faebc00) 00010000:00010000:2.0:1769074926.456211:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074926.456213:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e600, rc 0) 00000100:00100000:2.0:1769074926.456313:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67524:x1855007616126592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1311us (1542us total) trans 4294969060 rc 0/0 00000100:00100000:2.0:1769074926.456322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9511 00000100:00100000:0.0:1769074926.460816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.460948:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126720 00000100:00100000:2.0:1769074926.460963:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126720 00000100:00100000:2.0:1769074926.461041:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2747 00000100:00100000:2.0:1769074926.461053:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2420:x1855007616126720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.461079:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.461105:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acd2 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074926.461161:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074926.461189:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.461192:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.461203:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 175 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.461223:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 175 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.461238:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.461331:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2420:x1855007616126720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.461339:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2747 00000100:00100000:1.0:1769074926.465794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.465913:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126848 00000100:00100000:0.0:1769074926.465929:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126848 00000100:00100000:0.0:1769074926.466009:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2748 00000100:00100000:0.0:1769074926.466020:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:67524:x1855007616126848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.466045:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.466071:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acd9 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.466123:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.466141:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.466144:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.466149:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd9 expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.466192:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.466209:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074926.466226:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626628864:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074926.466379:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.469735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.469980:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626628864:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074926.470024:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd9 expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.470050:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49400, rc 0) 00000100:00100000:0.0:1769074926.470138:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:67524:x1855007616126848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4109us (4350us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.470149:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2748 00000100:00100000:2.0:1769074926.472215:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616126976 00000100:00100000:2.0:1769074926.472372:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616126976 00010000:00010000:2.0:1769074926.472456:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 2015 lvb_type: 1 00000100:00100000:2.0:1769074926.472641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1901 00000100:00100000:2.0:1769074926.472654:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2419:x1855007616126976:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074926.472676:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074926.472705:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.472729:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.472773:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98fea925 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd2 expref: 176 pid: 24564 timeout: 2015 lvb_type: 1 00010000:00010000:2.0:1769074926.472793:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.472796:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.472804:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd9 expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.472817:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd9 expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.472872:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49400/0x557988ac98fea92c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acd9 expref: 175 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074926.472889:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626628992:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074926.473016:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916149131240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.477676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.477861:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626628992:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074926.477897:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074926.477964:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2419:x1855007616126976:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5311us (8243us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.477978:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1901 00000100:00100000:1.0:1769074926.478709:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127232 00000100:00100000:1.0:1769074926.478722:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127232 00000100:00100000:1.0:1769074926.478780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1886 00000100:00100000:1.0:1769074926.478791:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+360:67524:x1855007616127232:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074926.479180:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67524:x1855007616127232:12345-192.168.204.32@tcp:35:cp.0 Request processed in 390us (1519us total) trans 4294969061 rc 0/0 00000100:00100000:1.0:1769074926.479188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1886 00000100:00100000:0.0:1769074926.516262:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626629120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769074926.516380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074926.516463:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1769074926.516471:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626629248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074926.516509:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074926.519969:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626629120 00000100:00100000:2.0:1769074926.519993:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626629120 00000100:00100000:2.0:1769074926.520069:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626629248 00000100:00100000:2.0:1769074926.520074:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626629248 00000100:00100000:2.0:1769074926.520098:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1769074926.520110:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626629120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1769074926.520157:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2781184 granted 493431744 pending 114688 free 3764449280 avail 3532926976 00000100:00100000:2.0:1769074926.520277:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626629120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.520286:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1769074926.520464:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626629120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769074926.521306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.521339:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127360 00000100:00100000:1.0:1769074926.521346:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127360 00000100:00100000:1.0:1769074926.521388:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9512 00000100:00100000:1.0:1769074926.521398:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67528:x1855007616127360:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074926.521418:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.521447:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fea933 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ace0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.521605:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074926.521625:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521639:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521655:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074926.521662:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521668:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521752:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521760:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521767:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521775:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.521779:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521791:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521806:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.521810:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.521815:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521821:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea93a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521836:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521843:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521849:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521853:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.521855:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521861:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521869:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.521872:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.521874:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521879:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea941 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.521916:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fea933 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ace0 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.521927:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.521930:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.521933:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98fea933 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ace0 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.521942:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074926.522005:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67528:x1855007616127360:12345-192.168.204.32@tcp:101:bash.0 Request processed in 608us (703us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.522012:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9512 00000100:00100000:0.0:1769074926.522966:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1769074926.522988:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626629248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1769074926.523016:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2809856 granted 493366208 pending 86016 free 3915657216 avail 3684134912 00000100:00100000:0.0:1769074926.523104:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626629248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.523111:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1769074926.523198:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626629248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074926.536069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.536203:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127488 00000100:00100000:2.0:1769074926.536219:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127488 00000100:00100000:2.0:1769074926.536352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9513 00000100:00100000:2.0:1769074926.536365:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67529:x1855007616127488:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.536398:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.536430:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea948 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ace7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.536585:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.536604:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536617:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536635:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.536643:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536654:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536731:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536952:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536960:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536967:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.536973:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536981:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.536996:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.537000:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.537006:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537012:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea94f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537028:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537034:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537040:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537046:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.537048:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537055:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537062:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604faeb700) 00010000:00010000:2.0:1769074926.537065:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.537068:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537074:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea956 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.537120:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea948 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ace7 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.537141:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.537144:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.537147:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea948 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ace7 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.537156:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.537258:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67529:x1855007616127488:12345-192.168.204.32@tcp:101:rm.0 Request processed in 894us (1204us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.537268:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9513 00000100:00100000:0.0:1769074926.540844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.541110:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127616 00000100:00100000:3.0:1769074926.541124:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127616 00000100:00100000:3.0:1769074926.541213:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 197 00000100:00100000:3.0:1769074926.541227:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2418:x1855007616127616:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074926.541278:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.541319:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea95d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acee expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.541401:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.541420:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541435:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541452:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.541459:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541467:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541599:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541608:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541615:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541621:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.541626:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541634:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541650:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.541653:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.541660:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541667:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea964 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541689:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541694:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541700:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541706:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.541709:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541716:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541723:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff91604f135c00) 00010000:00010000:3.0:1769074926.541725:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.541729:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541734:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea96b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.541973:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea95d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acee expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.541984:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.541987:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074926.541990:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea95d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acee expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.542002:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc -2) 00000100:00100000:3.0:1769074926.542087:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2418:x1855007616127616:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 863us (1259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074926.542096:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 197 00000100:00100000:3.0:1769074926.548386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.548443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.548574:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127744 00000100:00100000:2.0:1769074926.548587:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127744 00000100:00100000:2.0:1769074926.548657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9514 00000100:00100000:2.0:1769074926.548668:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67529:x1855007616127744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.548697:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.548725:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea972 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acf5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.548827:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.548847:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548861:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548880:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.548887:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548894:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548966:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548975:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548982:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.548989:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.548995:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549004:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549018:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.549022:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.549027:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549033:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98fea979 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549048:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549054:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549060:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549065:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.549068:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549073:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549080:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604faeb700) 00010000:00010000:2.0:1769074926.549083:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.549085:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549096:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea980 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.549142:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea972 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acf5 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.549152:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.549154:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.549158:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea972 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acf5 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.549168:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4e00, rc 0) 00000100:00100000:2.0:1769074926.549253:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67529:x1855007616127744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 585us (881us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.549262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9514 00000100:00100000:0.0:1769074926.549767:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616127872 00000100:00100000:0.0:1769074926.549775:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616127872 00000100:00100000:0.0:1769074926.549822:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 198 00000100:00100000:0.0:1769074926.549831:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2417:x1855007616127872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074926.549864:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.549878:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea987 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2acfc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.549921:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.549933:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.549942:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.549958:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.549965:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.549972:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550008:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550015:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550021:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550026:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.550030:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550040:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550051:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.550054:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.550057:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550063:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fea98e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550074:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550080:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550086:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550091:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.550093:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550099:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550106:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916174963a00) 00010000:00010000:0.0:1769074926.550108:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.550110:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550117:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fea995 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.550159:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea987 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acfc expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.550169:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.550171:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074926.550174:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98fea987 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2acfc expref: 362 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.550183:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc -2) 00000100:00100000:0.0:1769074926.550253:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2417:x1855007616127872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 422us (1809us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074926.550261:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 198 00000100:00100000:3.0:1769074926.566412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.566648:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128000 00000100:00100000:1.0:1769074926.566661:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128000 00000100:00100000:1.0:1769074926.566748:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9515 00000100:00100000:1.0:1769074926.566760:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67530:x1855007616128000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.566787:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.566813:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea99c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad03 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.566899:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074926.566918:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.566931:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.566951:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074926.566958:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.566964:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567032:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567040:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567047:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567054:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.567060:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567068:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567082:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.567086:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.567092:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567098:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297800/0x557988ac98fea9a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567113:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567120:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567134:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567139:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.567142:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567148:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567155:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.567157:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.567160:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567164:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fea9aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074926.567200:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea99c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad03 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.567212:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.567214:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.567217:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fea99c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad03 expref: 362 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.567225:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296600, rc 0) 00000100:00100000:1.0:1769074926.567316:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67530:x1855007616128000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 558us (921us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.567324:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9515 00000100:00100000:1.0:1769074926.569236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.569687:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128128 00000100:00100000:3.0:1769074926.569701:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128128 00000100:00100000:3.0:1769074926.569788:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00100000:3.0:1769074926.569800:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2420:x1855007616128128:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074926.569869:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.569893:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea9b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad0a expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.569965:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.569984:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.569998:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570015:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.570022:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570027:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570102:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570111:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570118:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570124:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.570140:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570147:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570160:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.570164:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.570169:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570176:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570201:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570207:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570213:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570218:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.570220:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570226:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570231:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604f135c00) 00010000:00010000:3.0:1769074926.570234:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.570237:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570242:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.570273:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea9b1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad0a expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.570284:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.570287:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074926.570291:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea9b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad0a expref: 362 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.570301:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45600, rc -2) 00000100:00100000:3.0:1769074926.570389:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:2420:x1855007616128128:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 590us (1163us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074926.570397:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00100000:3.0:1769074926.574668:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.574877:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128256 00000100:00100000:2.0:1769074926.574890:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128256 00000100:00100000:2.0:1769074926.574958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9516 00000100:00100000:2.0:1769074926.574967:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67530:x1855007616128256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.574994:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.575020:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea9c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.575098:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.575115:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575145:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575164:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.575170:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575176:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575240:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575247:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575254:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575260:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.575265:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575273:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575285:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.575300:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.575306:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575312:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98fea9cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575326:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575332:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575339:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575343:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.575346:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575351:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575357:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604faeb700) 00010000:00010000:2.0:1769074926.575359:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.575361:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575366:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98fea9d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.575399:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea9c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad42 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.575409:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.575411:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.575414:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fea9c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad42 expref: 362 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.575428:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.575513:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67530:x1855007616128256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 546us (858us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.575520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9516 00000100:00100000:1.0:1769074926.580600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.581054:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128512 00000100:00100000:3.0:1769074926.581070:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128512 00000100:00100000:3.0:1769074926.581159:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9517 00000100:00100000:3.0:1769074926.581171:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+361:67530:x1855007616128512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.581201:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.581231:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea9db lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad49 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.581433:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.581457:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.581470:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.581487:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.581494:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.581500:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074926.581915:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xbd:0x0], index 0: 0 00010000:00010000:3.0:1769074926.582113:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea9f0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.582136:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea9f0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582145:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea9f0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582190:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582198:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582205:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582216:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.582220:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582229:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582243:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.582247:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.582252:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582258:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98fea9e2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074926.582271:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000071dba5c6 reply state 00000000a1bff719 transno 4294969062 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582283:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.582290:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604f135c00) 00010000:00010000:3.0:1769074926.582292:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074926.582295:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074926.582334:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98fea9db lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad49 expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.582350:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44e00/0x557988ac98fea9f0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad49 expref: 363 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.582358:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x184:0x0].0x0 (ffff91604f135b00) 00010000:00010000:3.0:1769074926.582361:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074926.582364:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a44e00, rc 0) 00000100:00100000:3.0:1769074926.582765:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67530:x1855007616128512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1594us (2179us total) trans 4294969062 rc 0/0 00000100:00100000:3.0:1769074926.582776:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9517 00000100:00100000:1.0:1769074926.587217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.587418:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128640 00000100:00100000:0.0:1769074926.587432:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128640 00000100:00100000:0.0:1769074926.587889:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2749 00000100:00100000:0.0:1769074926.587904:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+174:2419:x1855007616128640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074926.587929:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.587957:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad50 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074926.587990:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074926.588016:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.588019:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.588030:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 175 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.588051:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 175 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074926.588068:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc 0) 00000100:00100000:0.0:1769074926.588198:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2419:x1855007616128640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 297us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.588206:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2749 00000100:00100000:1.0:1769074926.591418:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.591867:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128768 00000100:00100000:0.0:1769074926.591881:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128768 00000100:00100000:1.0:1769074926.592073:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2750 00000100:00100000:1.0:1769074926.592086:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:67530:x1855007616128768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.592112:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.592150:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad57 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.592193:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 176 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.592203:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.592206:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.592211:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad57 expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.592256:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 176 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.592273:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 176 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:1.0:1769074926.592301:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f970a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626629376:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074926.592438:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151c29480 going to sleep for 11 seconds 00000100:00100000:1.0:1769074926.595979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.596269:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616128896 00000100:00100000:0.0:1769074926.596294:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616128896 00010000:00010000:0.0:1769074926.596373:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 177 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:0.0:1769074926.596425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1902 00000100:00100000:0.0:1769074926.596436:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616128896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074926.596456:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074926.596485:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 177 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.596516:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 177 pid: 25313 timeout: 2015 lvb_type: 1 00010000:00010000:0.0:1769074926.596575:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.596578:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.596588:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad57 expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.596600:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad57 expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.596653:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad57 expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074926.596670:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626629504:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074926.596979:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160453849c0 going to sleep for 11 seconds 00010000:00010000:3.0:1769074926.597600:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98fea9fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad50 expref: 177 pid: 25313 timeout: 2015 lvb_type: 1 00000100:00100000:3.0:1769074926.597621:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f970a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626629376:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074926.597654:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e297800/0x557988ac98feaa05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad57 expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.597667:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297800, rc 0) 00000100:00100000:3.0:1769074926.597720:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:67530:x1855007616128768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5636us (6319us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074926.597729:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2750 00000100:00100000:1.0:1769074926.602642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.602760:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129152 00000100:00100000:2.0:1769074926.602775:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129152 00000100:00100000:2.0:1769074926.602852:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1887 00000100:00100000:2.0:1769074926.602863:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+364:67530:x1855007616129152:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074926.603292:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67530:x1855007616129152:12345-192.168.204.32@tcp:35:cp.0 Request processed in 429us (665us total) trans 4294969063 rc 0/0 00000100:00100000:2.0:1769074926.603301:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1887 00000100:00100000:0.0:1769074926.604459:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626629504:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074926.604497:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074926.604611:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2420:x1855007616128896:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8174us (8645us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.604624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1902 00000100:00100000:1.0:1769074926.630331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.630432:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129280 00000100:00100000:2.0:1769074926.630446:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129280 00000100:00100000:2.0:1769074926.630520:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 200 00000100:00100000:2.0:1769074926.630564:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2418:x1855007616129280:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074926.630647:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.630675:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa0c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad5e expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.630765:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.630784:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630797:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630820:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074926.630826:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630832:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630903:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630911:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630919:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630925:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.630930:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630939:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630953:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.630957:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.630963:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630969:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630985:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630992:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.630998:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.631003:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.631005:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.631011:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.631018:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604faeb700) 00010000:00010000:2.0:1769074926.631021:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.631023:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.631029:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa1a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074926.631064:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa0c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad5e expref: 366 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.631075:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.631077:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074926.631081:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad5e expref: 366 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.631091:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4e00, rc -2) 00000100:00100000:2.0:1769074926.631195:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2418:x1855007616129280:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 665us (879us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074926.631206:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 200 00000100:00100000:1.0:1769074926.645664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.645770:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129408 00000100:00100000:3.0:1769074926.645784:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129408 00000100:00100000:3.0:1769074926.645865:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9518 00000100:00100000:3.0:1769074926.645877:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67537:x1855007616129408:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074926.645905:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.645932:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaa21 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad96 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.646022:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.646046:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646063:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646083:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.646090:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646097:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646182:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646191:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646198:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646205:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.646210:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646219:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646234:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.646237:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.646243:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646250:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaa28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646265:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646270:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646276:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646281:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.646284:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646289:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646296:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604f135d00) 00010000:00010000:3.0:1769074926.646299:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.646301:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646307:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaa2f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.646343:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaa21 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad96 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.646353:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.646356:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.646360:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaa21 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad96 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.646369:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45600, rc 0) 00000100:00100000:3.0:1769074926.646451:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67537:x1855007616129408:12345-192.168.204.32@tcp:101:bash.0 Request processed in 576us (804us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.646460:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9518 00000100:00100000:1.0:1769074926.657946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.658289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.658450:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129664 00000100:00100000:3.0:1769074926.658462:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129664 00000100:00100000:3.0:1769074926.658580:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00100000:3.0:1769074926.658592:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2418:x1855007616129664:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074926.658628:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.658649:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa36 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ada4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.658707:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.658722:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658733:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658749:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.658756:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658762:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658818:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658826:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658832:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658838:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.658842:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658848:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658860:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.658864:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.658869:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658875:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658889:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658896:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658902:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658907:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.658911:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658917:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658923:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff91604f135400) 00010000:00010000:3.0:1769074926.658926:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.658928:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658933:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa44 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.658960:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa36 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ada4 expref: 366 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.658969:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.658971:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074926.658975:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa36 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ada4 expref: 366 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.658982:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc -2) 00000100:00100000:3.0:1769074926.659043:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:2418:x1855007616129664:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 453us (765us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074926.659051:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00100000:2.0:1769074926.660709:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129536 00000100:00100000:2.0:1769074926.660744:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129536 00000100:00100000:2.0:1769074926.660845:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9519 00000100:00100000:2.0:1769074926.660858:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67538:x1855007616129536:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.660885:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.660914:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ad9d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.661008:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.661027:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661042:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661059:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.661067:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661073:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661156:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661164:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661173:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661180:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.661185:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661194:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661210:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.661213:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.661219:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661224:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feaa52 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661240:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661246:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661251:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661257:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.661260:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661265:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661276:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604faeb700) 00010000:00010000:2.0:1769074926.661279:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.661282:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661381:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa59 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.661422:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa4b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad9d expref: 366 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.661433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.661436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.661439:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ad9d expref: 366 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.661448:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.661562:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67538:x1855007616129536:12345-192.168.204.32@tcp:101:rm.0 Request processed in 706us (3630us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.661571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9519 00000100:00100000:1.0:1769074926.669508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.669805:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129792 00000100:00100000:3.0:1769074926.669818:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129792 00000100:00100000:3.0:1769074926.669878:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9520 00000100:00100000:3.0:1769074926.669890:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67538:x1855007616129792:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074926.669925:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.669948:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adab expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.670022:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.670036:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670047:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670064:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074926.670071:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670077:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670139:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670147:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670153:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670159:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.670163:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670175:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670187:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.670190:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.670205:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670212:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa67 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670224:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670230:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670236:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670241:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.670244:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670249:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.670255:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604f135400) 00010000:00010000:3.0:1769074926.670257:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.671382:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.671399:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa6e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074926.671468:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa60 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adab expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.671480:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.671483:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.671487:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adab expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.671496:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc 0) 00000100:00100000:2.0:1769074926.671758:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67538:x1855007616129792:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1849us (2462us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.671773:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9520 00000100:00100000:1.0:1769074926.694999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.695375:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616129920 00000100:00100000:2.0:1769074926.695391:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616129920 00000100:00100000:2.0:1769074926.695473:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9521 00000100:00100000:2.0:1769074926.695485:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67539:x1855007616129920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.695520:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.695599:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adb2 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.695733:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.695751:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695764:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695783:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.695790:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695796:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695863:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695871:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695879:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695885:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.695889:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695898:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695913:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.695918:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.695923:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695930:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feaa7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695944:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695949:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695954:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695959:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.695962:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695968:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695974:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604faeb700) 00010000:00010000:2.0:1769074926.695977:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.695980:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.695985:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaa83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.696022:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa75 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adb2 expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.696034:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.696037:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.696041:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaa75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adb2 expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.696050:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4e00, rc 0) 00000100:00100000:2.0:1769074926.696133:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67539:x1855007616129920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 639us (1138us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.696143:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9521 00000100:00100000:2.0:1769074926.701623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.701716:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130048 00000100:00100000:3.0:1769074926.702380:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130048 00000100:00100000:3.0:1769074926.703003:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9522 00000100:00100000:3.0:1769074926.703020:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67539:x1855007616130048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.703046:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.703073:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adb9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.703155:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074926.703170:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703182:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703198:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074926.703206:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703213:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703266:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703273:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703279:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703297:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.703302:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703310:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703321:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.703325:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.703329:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703335:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feaa91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703348:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703354:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703360:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703366:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.703368:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703373:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703380:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604f135400) 00010000:00010000:3.0:1769074926.703382:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.703385:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703390:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaa98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.703419:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa8a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adb9 expref: 366 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.703429:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.703432:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.703436:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaa8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adb9 expref: 366 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.703444:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc 0) 00000100:00100000:3.0:1769074926.703548:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67539:x1855007616130048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 515us (1923us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074926.703557:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9522 00000100:00100000:1.0:1769074926.718311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.718490:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130304 00000100:00100000:3.0:1769074926.718501:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130304 00000100:00100000:3.0:1769074926.718610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9523 00000100:00100000:3.0:1769074926.718621:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+365:67539:x1855007616130304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.718644:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.718664:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaa9f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adc0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.718788:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074926.718805:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.718816:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.718831:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074926.718838:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.718844:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:3.0:1769074926.719134:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xbe:0x0], index 1: 0 00010000:00010000:3.0:1769074926.719460:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98feaab4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x185:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074926.719472:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98feaab4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719480:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98feaab4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719521:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719731:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719739:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719744:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.719748:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719754:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719766:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.719769:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.719774:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719780:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45400/0x557988ac98feaaa6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:3.0:1769074926.719792:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0195a13 reply state 00000000a72254a4 transno 4294969064 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719803:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074926.719809:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604f135d00) 00010000:00010000:3.0:1769074926.719811:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074926.719815:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074926.726433:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaa9f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc0 expref: 368 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.726457:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45800/0x557988ac98feaab4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc0 expref: 367 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.726464:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x185:0x0].0x0 (ffff91604f135e00) 00010000:00010000:2.0:1769074926.726467:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074926.726470:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45800, rc 0) 00000100:00100000:2.0:1769074926.726917:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67539:x1855007616130304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 8295us (8611us total) trans 4294969064 rc 0/0 00000100:00100000:2.0:1769074926.726927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9523 00000100:00100000:3.0:1769074926.736715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.736938:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130432 00000100:00100000:2.0:1769074926.736948:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130432 00000100:00100000:2.0:1769074926.737008:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2751 00000100:00100000:2.0:1769074926.737017:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2418:x1855007616130432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.737036:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.737057:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adc7 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074926.737080:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074926.737098:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.737100:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.737108:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 176 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.737185:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 176 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.737199:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.737257:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2418:x1855007616130432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 241us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.737264:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2751 00000100:00100000:1.0:1769074926.745703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.745799:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130560 00000100:00100000:3.0:1769074926.745810:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130560 00000100:00100000:3.0:1769074926.745874:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2752 00000100:00100000:3.0:1769074926.745885:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:67539:x1855007616130560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074926.745906:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.745927:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adce expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.745959:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074926.745966:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074926.745968:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074926.745972:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adce expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.746005:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074926.746019:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:3.0:1769074926.746033:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626629632:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074926.747579:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161473eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074926.751524:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049d21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626629632:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074926.751613:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adce expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.751635:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45400, rc 0) 00000100:00100000:2.0:1769074926.751702:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:67539:x1855007616130560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5818us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.751712:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2752 00000100:00100000:1.0:1769074926.752959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.753044:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130688 00000100:00100000:0.0:1769074926.753052:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130688 00010000:00010000:0.0:1769074926.753103:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074926.753187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1903 00000100:00100000:0.0:1769074926.753197:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616130688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074926.753211:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074926.753231:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.753246:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.753294:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e71ea00/0x557988ac98feaac2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adc7 expref: 177 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.753310:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.753312:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.753320:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adce expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.753330:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adce expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.753366:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052a45400/0x557988ac98feaac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adce expref: 176 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074926.753381:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626629760:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074926.753470:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384180 going to sleep for 11 seconds 00000100:00100000:2.0:1769074926.758856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.759300:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626629760:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074926.759325:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074926.759391:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2420:x1855007616130688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6195us (6438us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.759402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1903 00000100:00100000:3.0:1769074926.760822:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616130944 00000100:00100000:3.0:1769074926.760835:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616130944 00000100:00100000:3.0:1769074926.760953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1888 00000100:00100000:3.0:1769074926.760963:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+368:67539:x1855007616130944:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074926.761271:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67539:x1855007616130944:12345-192.168.204.32@tcp:35:cp.0 Request processed in 308us (2425us total) trans 4294969065 rc 0/0 00000100:00100000:3.0:1769074926.761277:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1888 00010000:00010000:1.0:1769074926.774236:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074926.795460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.795855:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131072 00000100:00100000:0.0:1769074926.795866:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131072 00000100:00100000:0.0:1769074926.795927:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9524 00000100:00100000:0.0:1769074926.795937:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67542:x1855007616131072:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074926.795961:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.795981:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaad0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2add5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.798246:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.798277:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798294:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798311:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.798318:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798324:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798383:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798390:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798396:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798402:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.798405:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798412:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798423:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.798426:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.798430:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798436:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feaad7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798450:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798454:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798460:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798464:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.798467:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798476:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798482:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.798484:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.798487:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798492:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feaade lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.798527:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaad0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2add5 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.798586:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.798589:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.798593:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaad0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2add5 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.798603:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49a00, rc 0) 00000100:00100000:1.0:1769074926.798677:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67542:x1855007616131072:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2740us (3226us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.798685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9524 00000100:00100000:1.0:1769074926.812408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.812462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.812597:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131328 00000100:00100000:0.0:1769074926.812607:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131328 00000100:00100000:0.0:1769074926.812661:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 202 00000100:00100000:0.0:1769074926.812670:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2420:x1855007616131328:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074926.812708:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074926.812726:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaae5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ade3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.812793:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.812808:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812820:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812834:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074926.812840:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812845:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812898:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812906:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812912:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812918:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.812921:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812928:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812940:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.812943:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.812947:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812953:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaaec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812964:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812969:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812974:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812979:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074926.812981:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812991:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.812996:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916174963e00) 00010000:00010000:0.0:1769074926.812998:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074926.813000:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.813005:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaaf3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074926.813028:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaae5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ade3 expref: 370 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.813037:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074926.813039:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074926.813042:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaae5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ade3 expref: 370 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.813050:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc -2) 00000100:00100000:0.0:1769074926.813114:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:2420:x1855007616131328:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 445us (650us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074926.813131:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 202 00000100:00100000:2.0:1769074926.814458:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131200 00000100:00100000:2.0:1769074926.814470:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131200 00000100:00100000:2.0:1769074926.814554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9525 00000100:00100000:2.0:1769074926.814563:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67543:x1855007616131200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.814590:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.814607:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaafa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2addc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.814666:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.814680:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814689:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814702:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.814707:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814712:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814753:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814759:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814769:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814775:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.814778:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814784:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.814800:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.814804:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814810:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feab01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814821:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814826:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814831:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814835:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.814838:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814843:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814852:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e63c100) 00010000:00010000:2.0:1769074926.814854:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.814857:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814862:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.814889:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaafa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2addc expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.814899:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.814901:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.814904:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feaafa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2addc expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.814912:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.814976:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67543:x1855007616131200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 414us (2576us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.814983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9525 00000100:00100000:1.0:1769074926.821795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.821870:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131456 00000100:00100000:2.0:1769074926.821881:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131456 00000100:00100000:2.0:1769074926.821941:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9526 00000100:00100000:2.0:1769074926.821950:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67543:x1855007616131456:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074926.821970:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.821991:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.822063:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.822077:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822089:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822103:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074926.822109:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822114:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822175:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822182:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822188:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822193:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.822197:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822203:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822218:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.822221:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.822225:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822231:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822241:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822246:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822252:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822257:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.822259:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822265:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822272:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e63cd00) 00010000:00010000:2.0:1769074926.822274:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.822276:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822291:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074926.822321:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab0f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adea expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.822331:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.822334:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.822337:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adea expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.822346:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074926.822412:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67543:x1855007616131456:12345-192.168.204.32@tcp:101:rm.0 Request processed in 462us (627us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.822419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9526 00000100:00100000:1.0:1769074926.847502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.847732:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131584 00000100:00100000:2.0:1769074926.847742:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131584 00000100:00100000:2.0:1769074926.847805:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9527 00000100:00100000:2.0:1769074926.847814:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67544:x1855007616131584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.847834:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.847855:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adf1 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.847924:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.847939:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.847949:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.847979:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.847991:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.847997:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848049:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848056:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848062:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848067:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.848071:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848077:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848089:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.848092:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.848096:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848102:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848114:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848119:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848157:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848162:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d5a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.848165:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848170:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848178:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e63cd00) 00010000:00010000:2.0:1769074926.848180:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.848183:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848188:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab32 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.848217:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab24 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adf1 expref: 370 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.848226:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.848229:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.848233:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adf1 expref: 370 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.848241:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246c00, rc 0) 00000100:00100000:2.0:1769074926.848309:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67544:x1855007616131584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 496us (818us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074926.848317:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9527 00000100:00100000:3.0:1769074926.853708:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.853820:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131712 00000100:00100000:1.0:1769074926.853840:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131712 00000100:00100000:1.0:1769074926.853896:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9528 00000100:00100000:1.0:1769074926.853905:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67544:x1855007616131712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.853925:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.853946:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98feab39 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adf8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.854020:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.854036:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854047:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854063:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.854069:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854075:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854137:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854143:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854149:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854154:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.854158:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854164:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854175:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.854177:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.854182:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854187:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab40 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854200:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854205:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854209:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854213:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.854216:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854221:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854227:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.854229:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.854231:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854240:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab47 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.854726:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98feab39 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adf8 expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.854738:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.854741:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.854744:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297c00/0x557988ac98feab39 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adf8 expref: 370 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.854754:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074926.854828:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67544:x1855007616131712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 923us (1131us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.854836:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9528 00000100:00100000:3.0:1769074926.862118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.862239:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616131968 00000100:00100000:2.0:1769074926.862250:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616131968 00000100:00100000:2.0:1769074926.862311:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9529 00000100:00100000:2.0:1769074926.862321:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+369:67544:x1855007616131968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.862343:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.862362:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab4e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2adff expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.862481:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.862496:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.862508:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.862525:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.862560:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.862567:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074926.862929:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xbe:0x0], index 0: 0 00010000:00010000:2.0:1769074926.863076:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab63 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074926.863087:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab63 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863095:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab63 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863139:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863147:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863153:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863159:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074926.863163:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863170:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863182:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074926.863186:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074926.863190:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863197:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feab55 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074926.863208:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000900ea748 reply state 000000000a01f745 transno 4294969066 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863217:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074926.863223:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e63cd00) 00010000:00010000:2.0:1769074926.863226:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074926.863229:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074926.863257:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feab4e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adff expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.863271:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246e00/0x557988ac98feab63 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2adff expref: 371 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074926.863277:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x186:0x0].0x0 (ffff91604e63c100) 00010000:00010000:2.0:1769074926.863279:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074926.863281:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e246e00, rc 0) 00000100:00100000:2.0:1769074926.863354:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67544:x1855007616131968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1034us (1245us total) trans 4294969066 rc 0/0 00000100:00100000:2.0:1769074926.863362:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9529 00000100:00100000:3.0:1769074926.870879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.871108:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132096 00000100:00100000:2.0:1769074926.871119:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132096 00000100:00100000:2.0:1769074926.871191:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2753 00000100:00100000:2.0:1769074926.871201:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+175:2419:x1855007616132096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074926.871220:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074926.871244:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae06 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074926.871268:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074926.871288:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.871290:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074926.871299:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 176 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.871314:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 176 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074926.871333:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ea00, rc 0) 00000100:00100000:2.0:1769074926.871392:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2419:x1855007616132096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 192us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074926.871400:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2753 00000100:00100000:3.0:1769074926.875152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.875237:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132224 00000100:00100000:1.0:1769074926.875246:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132224 00000100:00100000:1.0:1769074926.875309:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2754 00000100:00100000:1.0:1769074926.875317:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:67544:x1855007616132224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074926.875334:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.875350:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae0d expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.875377:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.875385:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.875388:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074926.875391:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae0d expref: 177 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.875422:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074926.875435:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:1.0:1769074926.875447:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626629888:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074926.875644:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151c29000 going to sleep for 11 seconds 00000100:00100000:3.0:1769074926.884999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074926.885178:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132352 00000100:00100000:0.0:1769074926.885188:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132352 00010000:00010000:0.0:1769074926.885243:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 178 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074926.885293:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1904 00000100:00100000:0.0:1769074926.885311:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2419:x1855007616132352:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074926.885326:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1769074926.885437:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626629888:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074926.885469:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae0d expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.885486:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297c00, rc 0) 00000100:00100000:1.0:1769074926.885579:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67544:x1855007616132224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10251us (10425us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074926.885589:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2754 00010000:00010000:0.0:1769074926.885693:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.885707:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.885731:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e71ea00/0x557988ac98feab71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae06 expref: 177 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074926.885743:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.885746:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074926.885753:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae0d expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.885764:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae0d expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074926.885799:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e297c00/0x557988ac98feab78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae0d expref: 176 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074926.885825:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626630016:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074926.885997:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384900 going to sleep for 11 seconds 00000100:00100000:0.0:1769074926.888621:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626630016:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074926.888650:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074926.888718:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2419:x1855007616132352:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3408us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074926.888730:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1904 00000100:00100000:3.0:1769074926.889021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074926.889164:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132608 00000100:00100000:2.0:1769074926.889172:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132608 00000100:00100000:2.0:1769074926.889220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1889 00000100:00100000:2.0:1769074926.889231:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+372:67544:x1855007616132608:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074926.889551:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67544:x1855007616132608:12345-192.168.204.32@tcp:35:cp.0 Request processed in 302us (511us total) trans 4294969067 rc 0/0 00000100:00100000:2.0:1769074926.889559:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1889 00000100:00100000:3.0:1769074926.933068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.933195:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132736 00000100:00100000:1.0:1769074926.933206:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132736 00000100:00100000:1.0:1769074926.933269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9530 00000100:00100000:1.0:1769074926.933289:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67547:x1855007616132736:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074926.933311:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.933332:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab7f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.933404:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.933418:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933430:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933446:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.933453:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933459:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933550:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933558:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933565:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933571:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.933575:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933582:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933598:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.933601:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.933606:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933613:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feab86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933637:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933643:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933650:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933655:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.933659:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933665:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933672:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.933675:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.933678:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933685:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.933715:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab7f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae14 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.933726:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.933728:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.933732:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae14 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.933761:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297e00, rc 0) 00000100:00100000:1.0:1769074926.933826:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67547:x1855007616132736:12345-192.168.204.32@tcp:101:bash.0 Request processed in 548us (768us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.933834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9530 00000100:00100000:3.0:1769074926.955467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.955582:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132864 00000100:00100000:1.0:1769074926.955593:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132864 00000100:00100000:1.0:1769074926.955657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9531 00000100:00100000:1.0:1769074926.955667:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67548:x1855007616132864:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074926.955693:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.955714:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab94 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.955789:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.955804:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955816:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955829:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.955839:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955846:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955900:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955908:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955914:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955920:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e296600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.955924:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955931:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955944:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.955948:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.955952:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955958:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98feab9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955972:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955978:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955983:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955988:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.955991:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.955996:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.956002:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.956005:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.956007:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.956013:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaba2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.956045:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab94 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae1b expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.956055:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.956057:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.956061:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feab94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae1b expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.956071:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297e00, rc 0) 00000100:00100000:1.0:1769074926.956193:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67548:x1855007616132864:12345-192.168.204.32@tcp:101:rm.0 Request processed in 527us (734us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.956202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9531 00000100:00100000:0.0:1769074926.962059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074926.962189:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616132992 00000100:00100000:3.0:1769074926.962199:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616132992 00000100:00100000:3.0:1769074926.962309:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 203 00000100:00100000:3.0:1769074926.962319:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616132992:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074926.962376:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074926.962396:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaba9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae22 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.962456:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.962471:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962482:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962888:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074926.962898:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962905:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962959:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962966:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962973:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962978:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.962982:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.962989:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963001:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.963004:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.963009:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963015:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feabb0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963027:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963033:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963040:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963045:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074926.963047:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963052:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963059:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135400) 00010000:00010000:3.0:1769074926.963061:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074926.963063:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963069:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabb7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074926.963095:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaba9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae22 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.963105:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074926.963108:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074926.963111:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaba9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae22 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074926.963131:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc -2) 00000100:00100000:3.0:1769074926.963195:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616132992:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 877us (1145us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074926.963203:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 203 00000100:00100000:2.0:1769074926.969699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074926.969912:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133120 00000100:00100000:1.0:1769074926.969923:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133120 00000100:00100000:1.0:1769074926.969992:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9532 00000100:00100000:1.0:1769074926.970002:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67548:x1855007616133120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074926.970023:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074926.970045:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feabbe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.970132:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.970147:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970159:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970174:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074926.970181:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970188:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970240:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970247:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970253:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970263:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.970267:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970274:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970375:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.970380:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.970385:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970391:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feabc5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970407:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970411:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970416:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970420:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074926.970423:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970429:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970435:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604e2b2200) 00010000:00010000:1.0:1769074926.970437:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.970441:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970445:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094a00/0x557988ac98feabcc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074926.970480:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feabbe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae5a expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.970489:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074926.970491:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074926.970494:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feabbe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae5a expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074926.970502:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074926.971059:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67548:x1855007616133120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1055us (1367us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074926.971067:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9532 00000100:00100000:1.0:1769074927.003021:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.003069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.003177:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133248 00000100:00100000:0.0:1769074927.003188:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133248 00000100:00100000:0.0:1769074927.003256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9533 00000100:00100000:0.0:1769074927.003269:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67551:x1855007616133248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.003298:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.003319:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feabd3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.003385:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1769074927.003400:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003411:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003424:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1769074927.003429:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003434:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003485:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003496:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003501:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003507:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.003510:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003518:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003567:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.003570:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.003576:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003581:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feabda lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003595:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003600:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003605:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003609:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.003612:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003633:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003641:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff916174963e00) 00010000:00010000:0.0:1769074927.003645:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.003648:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003653:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feabe1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074927.003683:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feabd3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae61 expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.003693:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.003695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.003699:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feabd3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae61 expref: 374 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.003707:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49a00, rc 0) 00000100:00100000:0.0:1769074927.003759:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67551:x1855007616133248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 494us (688us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.003767:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9533 00000100:00100000:3.0:1769074927.004144:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133376 00000100:00100000:3.0:1769074927.004151:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133376 00000100:00100000:3.0:1769074927.004191:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 204 00000100:00100000:3.0:1769074927.004199:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616133376:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074927.004243:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.004255:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feabe8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ae68 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.004299:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074927.004309:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004316:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004328:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074927.004334:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004340:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004370:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004377:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004382:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004387:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.004390:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004396:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004405:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.004408:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.004411:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004416:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feabef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004426:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004432:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004437:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004442:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.004444:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004450:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004457:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135400) 00010000:00010000:3.0:1769074927.004459:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.004462:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004467:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feabf6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074927.004490:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feabe8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae68 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.004498:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.004500:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074927.004503:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feabe8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ae68 expref: 374 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.004511:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc -2) 00000100:00100000:3.0:1769074927.004836:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:2419:x1855007616133376:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 636us (1822us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074927.004844:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 204 00000100:00080000:1.0:1769074927.005264:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074927.007346:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.007427:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133504 00000100:00100000:3.0:1769074927.007438:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133504 00000100:00100000:3.0:1769074927.007503:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9534 00000100:00100000:3.0:1769074927.007514:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67551:x1855007616133504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.007807:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.007830:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feabfd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aea0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.007904:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074927.007921:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.007934:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.007950:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074927.007957:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.007963:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008017:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008025:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008031:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008037:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.008041:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008048:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008061:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.008064:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.008068:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008075:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feac04 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008088:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008095:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008100:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008105:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.008108:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008114:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008135:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604f135f00) 00010000:00010000:3.0:1769074927.008138:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.008140:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008145:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac0b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074927.008176:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feabfd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aea0 expref: 374 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.008185:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.008187:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.008190:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feabfd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aea0 expref: 374 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.008202:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074927.008273:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67551:x1855007616133504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 761us (936us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.008281:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9534 00000100:00100000:2.0:1769074927.025381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.025458:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133760 00000100:00100000:3.0:1769074927.025469:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133760 00000100:00100000:3.0:1769074927.025518:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9535 00000100:00100000:3.0:1769074927.025566:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+373:67551:x1855007616133760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.025585:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.025608:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac12 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aea7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.026088:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.026103:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.026114:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.026139:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x26fc322 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.026146:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.026157:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074927.026430:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xbf:0x0], index 1: 0 00010000:00010000:2.0:1769074927.027187:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feac27 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.027200:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feac27 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027209:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feac27 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027241:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027248:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027255:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027260:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.027264:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027271:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027283:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.027286:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.027290:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027299:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feac19 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074927.027310:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006572383c reply state 000000000d4e5e0a transno 4294969068 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027321:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.027327:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604e63c200) 00010000:00010000:2.0:1769074927.027329:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074927.027332:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074927.027363:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feac12 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aea7 expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.027378:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d5a00/0x557988ac98feac27 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aea7 expref: 375 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.027386:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x187:0x0].0x0 (ffff91604e63c800) 00010000:00010000:2.0:1769074927.027388:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074927.027391:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d5a00, rc 0) 00000100:00100000:2.0:1769074927.027568:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67551:x1855007616133760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1955us (2146us total) trans 4294969068 rc 0/0 00000100:00100000:2.0:1769074927.027578:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9535 00000100:00100000:0.0:1769074927.037258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.038066:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616133888 00000100:00100000:1.0:1769074927.038077:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616133888 00000100:00100000:1.0:1769074927.038166:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2755 00000100:00100000:1.0:1769074927.038177:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2420:x1855007616133888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.038195:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1769074927.038212:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1769074927.038216:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aeae expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074927.038247:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074927.038268:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.038269:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.038357:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.038427:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.038437:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074927.038577:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616133888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 400us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.038585:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2755 00000100:00100000:0.0:1769074927.042690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.042874:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134016 00000100:00100000:1.0:1769074927.042884:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134016 00000100:00100000:1.0:1769074927.042989:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2756 00000100:00100000:1.0:1769074927.042999:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:67551:x1855007616134016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.043018:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.043036:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aeb5 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.043065:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.043072:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.043074:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.043078:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeb5 expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.043110:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.043135:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:1.0:1769074927.043150:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f922a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626630144:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074927.043291:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151c29000 going to sleep for 11 seconds 00000100:00100000:2.0:1769074927.047003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.047418:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134144 00000100:00100000:0.0:1769074927.047429:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134144 00010000:00010000:0.0:1769074927.047481:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 179 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074927.047571:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1905 00000100:00100000:0.0:1769074927.047581:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616134144:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074927.047595:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074927.047626:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 179 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.047641:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 179 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.047667:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.047669:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.047677:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeb5 expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.047687:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeb5 expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.047725:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeb5 expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074927.047749:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626630272:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074927.047829:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384900 going to sleep for 11 seconds 00010000:00010000:1.0:1769074927.049098:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e095600/0x557988ac98feac35 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeae expref: 179 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:1.0:1769074927.049113:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f922a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626630144:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074927.049148:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e094a00/0x557988ac98feac3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aeb5 expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.049156:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094a00, rc 0) 00000100:00100000:1.0:1769074927.049236:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67551:x1855007616134016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6240us (6557us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.049242:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2756 00000100:00100000:0.0:1769074927.050490:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626630272:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074927.050510:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074927.050846:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2419:x1855007616134144:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3265us (3851us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.050857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1905 00000100:00100000:2.0:1769074927.060602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.060854:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134400 00000100:00100000:3.0:1769074927.060863:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134400 00000100:00100000:3.0:1769074927.060914:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1890 00000100:00100000:3.0:1769074927.060924:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+376:67551:x1855007616134400:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074927.061258:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67551:x1855007616134400:12345-192.168.204.32@tcp:35:cp.0 Request processed in 336us (662us total) trans 4294969069 rc 0/0 00000100:00100000:3.0:1769074927.061264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1890 00000100:00100000:3.0:1769074927.097623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.098553:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134528 00000100:00100000:0.0:1769074927.098565:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134528 00000100:00100000:0.0:1769074927.098630:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00100000:0.0:1769074927.098639:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2420:x1855007616134528:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074927.098697:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.098717:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac43 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aebc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.098772:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.098787:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098798:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098812:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.098819:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098825:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098873:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098881:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098888:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098894:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.098899:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098907:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098918:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.098921:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.098926:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098945:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098959:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098964:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098970:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098976:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.098986:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.098992:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.099004:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff916174963e00) 00010000:00010000:0.0:1769074927.099006:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.099009:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.099014:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac51 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.099042:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac43 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aebc expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.099053:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.099056:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074927.099060:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aebc expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.099071:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc -2) 00000100:00100000:0.0:1769074927.099153:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2420:x1855007616134528:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 514us (1549us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074927.099162:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00100000:3.0:1769074927.127032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.127508:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134656 00000100:00100000:0.0:1769074927.127518:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134656 00000100:00100000:0.0:1769074927.127625:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9536 00000100:00100000:0.0:1769074927.127635:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67559:x1855007616134656:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074927.127655:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.127677:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aef4 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.127745:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.127762:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127771:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127785:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.127792:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127799:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127851:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127858:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127865:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127872:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.127876:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127884:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127900:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.127903:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.127907:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127914:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac5f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127926:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127932:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127938:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127944:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.127946:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127950:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127957:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff916174963e00) 00010000:00010000:0.0:1769074927.127960:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.127962:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.127968:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac66 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.128013:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac58 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aef4 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.128023:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.128026:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.128030:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aef4 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.128039:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074927.128094:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67559:x1855007616134656:12345-192.168.204.32@tcp:101:bash.0 Request processed in 460us (1071us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.128102:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9536 00000100:00080000:3.0:1769074927.130021:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769074927.145264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.145390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.147702:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134912 00000100:00100000:0.0:1769074927.147718:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134912 00000100:00100000:0.0:1769074927.147799:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 206 00000100:00100000:0.0:1769074927.147810:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616134912:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074927.147857:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.147884:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af02 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.147949:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.147965:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.147978:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.147993:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.148004:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148011:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148064:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148072:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148078:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148085:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.148089:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148096:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148107:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.148110:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.148127:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148133:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feac74 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148146:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148152:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148158:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148163:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.148166:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148172:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148178:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff916174963e00) 00010000:00010000:0.0:1769074927.148181:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.148183:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148189:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feac7b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.148216:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac6d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af02 expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.148226:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.148228:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074927.148231:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feac6d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af02 expref: 378 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.148241:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc -2) 00000100:00100000:0.0:1769074927.148314:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:2417:x1855007616134912:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 505us (2924us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074927.148322:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 206 00000100:00100000:1.0:1769074927.149306:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616134784 00000100:00100000:1.0:1769074927.149318:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616134784 00000100:00100000:1.0:1769074927.149465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9537 00000100:00100000:1.0:1769074927.149475:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67560:x1855007616134784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074927.149491:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.149506:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feac82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2aefb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.149578:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.149590:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149612:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149625:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.149633:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149638:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149682:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149688:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149694:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149699:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.149704:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149714:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149724:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.149727:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.149730:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149735:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98feac89 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149747:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149753:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149758:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149763:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.149766:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149772:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149778:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604e2b2b00) 00010000:00010000:1.0:1769074927.149780:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.149783:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98feac90 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.149815:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feac82 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aefb expref: 378 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.149823:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.149825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.149828:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feac82 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2aefb expref: 378 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.149836:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074927.149889:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67560:x1855007616134784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 416us (4635us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.149896:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9537 00000100:00100000:3.0:1769074927.153560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.153745:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135040 00000100:00100000:1.0:1769074927.153759:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135040 00000100:00100000:1.0:1769074927.153826:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9538 00000100:00100000:1.0:1769074927.153837:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67560:x1855007616135040:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074927.153857:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.153879:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feac97 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.153982:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.153996:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154007:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154026:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.154033:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154039:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154089:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154097:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154103:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154108:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.154112:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154128:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154140:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.154143:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.154149:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154155:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feac9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154169:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154174:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154180:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154185:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.154188:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154193:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154200:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604e2b2800) 00010000:00010000:1.0:1769074927.154202:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.154204:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154209:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feaca5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.154238:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feac97 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af09 expref: 378 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.154247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.154249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.154252:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feac97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af09 expref: 378 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.154260:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074927.154332:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67560:x1855007616135040:12345-192.168.204.32@tcp:101:rm.0 Request processed in 497us (807us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.154339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9538 00000100:00100000:2.0:1769074927.186620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.187078:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135168 00000100:00100000:0.0:1769074927.187090:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135168 00000100:00100000:0.0:1769074927.187164:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9539 00000100:00100000:0.0:1769074927.187174:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67561:x1855007616135168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.187197:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.187218:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af10 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.187474:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.187486:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187494:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187504:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.187508:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187512:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187610:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187615:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187619:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187623:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.187626:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187631:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187639:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.187641:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.187644:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187647:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feacb3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187657:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187660:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187664:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187666:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.187668:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187671:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187674:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff916174963e00) 00010000:00010000:0.0:1769074927.187675:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.187677:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187681:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.187705:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af10 expref: 378 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.187710:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.187712:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.187714:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af10 expref: 378 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.187720:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074927.187836:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67561:x1855007616135168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 663us (1227us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.187841:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9539 00000100:00100000:3.0:1769074927.193839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.194043:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135296 00000100:00100000:0.0:1769074927.194054:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135296 00000100:00100000:0.0:1769074927.194170:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9540 00000100:00100000:0.0:1769074927.194181:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67561:x1855007616135296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.194202:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.194221:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacc1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af17 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.194296:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.194311:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194323:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194337:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.194344:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194350:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194423:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194431:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194438:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194444:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.194448:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194456:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194468:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.194471:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.194476:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194482:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feacc8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194494:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194500:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194505:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194510:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.194513:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194517:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194523:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff916174963e00) 00010000:00010000:0.0:1769074927.194526:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.194925:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194934:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaccf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.194970:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacc1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af17 expref: 378 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.194980:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.194983:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.194987:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49e00/0x557988ac98feacc1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af17 expref: 378 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.195002:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074927.195075:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67561:x1855007616135296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 895us (1244us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.195083:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9540 00000100:00100000:0.0:1769074927.199190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.199269:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135552 00000100:00100000:2.0:1769074927.199289:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135552 00000100:00100000:2.0:1769074927.199340:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9541 00000100:00100000:2.0:1769074927.199349:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614858f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+377:67561:x1855007616135552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074927.199378:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.199403:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feacd6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af1e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.199642:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.199658:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.199669:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.199686:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8592b98f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.199693:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.199699:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074927.199977:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xbf:0x0], index 0: 0 00010000:00010000:2.0:1769074927.200129:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98feaceb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074927.200139:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98feaceb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200147:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98feaceb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200179:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200186:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200193:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200200:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.200204:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200211:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200223:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.200227:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.200231:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200237:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feacdd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074927.200251:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec4eb51d reply state 0000000070fc1da1 transno 4294969070 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200262:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074927.200269:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604e63ca00) 00010000:00010000:2.0:1769074927.200272:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074927.200275:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074927.200301:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feacd6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af1e expref: 380 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.200315:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499600/0x557988ac98feaceb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af1e expref: 379 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.200321:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x188:0x0].0x0 (ffff91604e63c400) 00010000:00010000:2.0:1769074927.200324:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074927.200326:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499600, rc 0) 00000100:00100000:2.0:1769074927.201145:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614858f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67561:x1855007616135552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1792us (1961us total) trans 4294969070 rc 0/0 00000100:00100000:2.0:1769074927.201155:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9541 00000100:00100000:3.0:1769074927.208349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.208577:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135680 00000100:00100000:1.0:1769074927.208587:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135680 00000100:00100000:1.0:1769074927.208653:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2757 00000100:00100000:1.0:1769074927.208664:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+176:2420:x1855007616135680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.208683:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.208708:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af25 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074927.208746:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074927.208768:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.208770:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.208779:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.208796:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 177 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.208808:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297a00, rc 0) 00000100:00100000:1.0:1769074927.208873:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616135680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 210us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.208880:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2757 00000100:00080000:3.0:1769074927.209216:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074927.214649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.214743:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135808 00000100:00100000:0.0:1769074927.214753:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135808 00000100:00100000:0.0:1769074927.214820:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2758 00000100:00100000:0.0:1769074927.214830:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:67561:x1855007616135808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.214850:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.214867:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af2c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.214897:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.214906:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.214908:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.214912:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af2c expref: 178 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.214945:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.214959:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074927.215085:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626630400:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074927.215191:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384180 going to sleep for 11 seconds 00000100:00100000:0.0:1769074927.218735:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626630400:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074927.218773:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af2c expref: 178 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.218792:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49e00, rc 0) 00000100:00100000:0.0:1769074927.218854:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67561:x1855007616135808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4026us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.218864:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2758 00000100:00100000:3.0:1769074927.219931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.220003:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616135936 00000100:00100000:0.0:1769074927.220012:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616135936 00010000:00010000:0.0:1769074927.220304:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074927.220345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1906 00000100:00100000:0.0:1769074927.220365:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2420:x1855007616135936:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074927.220380:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074927.220401:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.220427:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.220456:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e297a00/0x557988ac98feacf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af25 expref: 178 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.220471:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.220473:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.220480:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af2c expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.220490:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af2c expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.220525:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a49e00/0x557988ac98fead00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af2c expref: 177 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074927.220582:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626630528:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074927.220654:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384180 going to sleep for 11 seconds 00000100:00100000:2.0:1769074927.224292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.224390:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136192 00000100:00100000:3.0:1769074927.224399:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136192 00000100:00100000:3.0:1769074927.224464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1891 00000100:00100000:3.0:1769074927.224475:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+380:67561:x1855007616136192:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074927.224793:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67561:x1855007616136192:12345-192.168.204.32@tcp:35:cp.0 Request processed in 320us (518us total) trans 4294969071 rc 0/0 00000100:00100000:3.0:1769074927.224801:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1891 00000100:00100000:0.0:1769074927.225288:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626630528:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074927.225311:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074927.225341:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616135936:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4988us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.225350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1906 00000100:00100000:2.0:1769074927.265807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.265939:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136320 00000100:00100000:0.0:1769074927.265950:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136320 00000100:00100000:0.0:1769074927.267307:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9542 00000100:00100000:0.0:1769074927.267324:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67564:x1855007616136320:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074927.267349:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.267384:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead07 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af33 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.267453:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.267466:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267478:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267495:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.267501:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267507:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267588:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267595:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267611:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267617:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.267621:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267632:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267643:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.267645:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.267651:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267656:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267669:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267675:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267679:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267684:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.267686:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267691:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267699:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff916174963e00) 00010000:00010000:0.0:1769074927.267701:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.267704:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267709:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead15 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.267739:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead07 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af33 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.267747:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.267750:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.267753:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead07 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af33 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.267762:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.267888:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67564:x1855007616136320:12345-192.168.204.32@tcp:101:bash.0 Request processed in 569us (2089us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.267897:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9542 00000100:00100000:1.0:1769074927.282046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.282311:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136576 00000100:00100000:0.0:1769074927.282323:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136576 00000100:00100000:0.0:1769074927.282401:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 207 00000100:00100000:0.0:1769074927.282411:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616136576:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074927.282454:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.282474:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead1c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af41 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.282851:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.282866:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.282879:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.282898:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074927.282905:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.282911:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.282962:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.282969:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283691:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283703:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.283708:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283717:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283731:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.283735:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.283741:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283746:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead23 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283763:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283770:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283777:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283781:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.283784:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283791:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283797:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff916174963e00) 00010000:00010000:0.0:1769074927.283800:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.283802:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283808:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead2a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074927.283842:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead1c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af41 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.283853:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.283856:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074927.283859:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead1c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af41 expref: 382 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.283870:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc -2) 00000100:00100000:0.0:1769074927.284418:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:2417:x1855007616136576:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2005us (2378us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074927.284429:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 207 00000100:00100000:2.0:1769074927.292459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.292578:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136448 00000100:00100000:0.0:1769074927.292589:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136448 00000100:00100000:0.0:1769074927.292655:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9543 00000100:00100000:0.0:1769074927.292664:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67565:x1855007616136448:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.292685:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.292705:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead31 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af3a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.292770:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.292784:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292795:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292811:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.292819:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292825:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292879:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292886:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292893:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292900:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.292904:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292911:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292924:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.292927:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.292931:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292937:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292952:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292958:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292964:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292969:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.292971:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292977:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292988:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff916174963e00) 00010000:00010000:0.0:1769074927.292990:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.292993:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.292999:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.293027:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead31 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af3a expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.293038:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.293040:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.293044:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af3a expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.293053:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.293129:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67565:x1855007616136448:12345-192.168.204.32@tcp:101:rm.0 Request processed in 465us (679us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.293137:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9543 00000100:00100000:2.0:1769074927.295449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.295583:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136704 00000100:00100000:1.0:1769074927.295594:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136704 00000100:00100000:1.0:1769074927.295640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9544 00000100:00100000:1.0:1769074927.295655:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67565:x1855007616136704:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074927.295674:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.295699:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead46 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af48 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.295770:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.295786:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295797:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295811:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.295818:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295825:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295874:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295882:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295889:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295895:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.295899:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295911:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295924:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.295927:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.295932:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295939:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295952:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295958:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295964:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295968:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.295971:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295977:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295985:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff91604e2b2a00) 00010000:00010000:1.0:1769074927.295988:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.295990:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.295996:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead54 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.296027:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead46 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af48 expref: 382 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.296037:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.296039:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.296042:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead46 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af48 expref: 382 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.296050:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296600, rc 0) 00000100:00100000:1.0:1769074927.296123:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67565:x1855007616136704:12345-192.168.204.32@tcp:101:rm.0 Request processed in 459us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.296132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9544 00000100:00100000:2.0:1769074927.307231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.311959:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136832 00000100:00100000:0.0:1769074927.311986:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136832 00000100:00100000:0.0:1769074927.312054:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9545 00000100:00100000:0.0:1769074927.312065:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67566:x1855007616136832:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.312260:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.312426:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead5b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af4f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.312598:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.312614:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312626:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312640:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.312647:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312654:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312707:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312715:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312722:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312816:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.312822:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312830:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312845:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.312849:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.312854:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312860:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98fead62 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312874:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312880:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312887:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312892:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.312895:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312902:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312909:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff916174963e00) 00010000:00010000:0.0:1769074927.312911:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.312914:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312920:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98fead69 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.312951:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead5b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af4f expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.312962:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.312965:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.312969:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98fead5b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af4f expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.313268:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.313615:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67566:x1855007616136832:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1427us (6270us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.313624:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9545 00000100:00100000:2.0:1769074927.320384:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.320627:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616136960 00000100:00100000:1.0:1769074927.320638:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616136960 00000100:00100000:1.0:1769074927.320697:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9546 00000100:00100000:1.0:1769074927.320707:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67566:x1855007616136960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.320738:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.320762:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af56 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.320827:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.320843:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320855:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320873:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.320880:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320886:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320936:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320944:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320951:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320957:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.320962:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320970:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.320991:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.320994:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.321000:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321006:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fead77 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321019:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321026:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321032:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321037:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.321040:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321046:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321053:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff91604e2b2a00) 00010000:00010000:1.0:1769074927.321056:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.321058:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321064:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fead7e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.321104:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead70 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af56 expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.321128:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.321131:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.321135:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e296600/0x557988ac98fead70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af56 expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.321145:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296600, rc 0) 00000100:00100000:1.0:1769074927.321212:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67566:x1855007616136960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 506us (838us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.321221:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9546 00000100:00100000:2.0:1769074927.324883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.324948:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137216 00000100:00100000:1.0:1769074927.324956:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137216 00000100:00100000:1.0:1769074927.325010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9547 00000100:00100000:1.0:1769074927.325019:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+381:67566:x1855007616137216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.325037:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.325057:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fead85 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af5d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.325179:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.325192:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.325200:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.325210:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.325214:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.325218:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:1.0:1769074927.325515:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc0:0x0], index 1: 0 00010000:00010000:1.0:1769074927.325682:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fead9a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x189:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.325690:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fead9a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.325698:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fead9a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326587:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326595:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326599:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326604:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.326608:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326615:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.326631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.326636:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326641:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fead8c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:1.0:1769074927.326813:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a658fcb reply state 0000000099cf6ef7 transno 4294969072 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326826:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.326832:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff91604e2b2400) 00010000:00010000:1.0:1769074927.326835:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074927.326838:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074927.326876:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fead85 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af5d expref: 384 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.326888:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094600/0x557988ac98fead9a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af5d expref: 383 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.326895:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x189:0x0].0x0 (ffff91604e2b2e00) 00010000:00010000:1.0:1769074927.326898:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074927.326900:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094600, rc 0) 00000100:00100000:1.0:1769074927.326970:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67566:x1855007616137216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1951us (2093us total) trans 4294969072 rc 0/0 00000100:00100000:1.0:1769074927.327812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9547 00000100:00100000:3.0:1769074927.329685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.329743:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137344 00000100:00100000:0.0:1769074927.329756:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137344 00000100:00100000:0.0:1769074927.329804:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2759 00000100:00100000:0.0:1769074927.329812:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2419:x1855007616137344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.329829:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.329850:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af64 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074927.329869:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074927.329884:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.329885:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.329892:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 178 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.329904:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 178 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.329919:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49600, rc 0) 00000100:00100000:0.0:1769074927.329958:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2419:x1855007616137344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 147us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.329962:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2759 00000100:00100000:2.0:1769074927.340292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.342514:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137472 00000100:00100000:1.0:1769074927.342828:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137472 00000100:00100000:1.0:1769074927.342938:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2760 00000100:00100000:1.0:1769074927.342948:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67566:x1855007616137472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.342968:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.342998:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af6b expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.343028:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.343037:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.343039:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.343044:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af6b expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.343084:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.343097:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:1.0:1769074927.343111:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f920000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626630656:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074927.343239:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916181a80000 going to sleep for 11 seconds 00000100:00100000:1.0:1769074927.347437:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f920000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626630656:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074927.347475:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af6b expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.347495:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e296600, rc 0) 00000100:00100000:1.0:1769074927.347855:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67566:x1855007616137472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4906us (7586us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.347865:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2760 00000100:00100000:3.0:1769074927.350123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.350224:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137600 00000100:00100000:2.0:1769074927.350234:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137600 00010000:00010000:2.0:1769074927.350296:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:2.0:1769074927.350334:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1907 00000100:00100000:2.0:1769074927.350342:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616137600:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074927.350365:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074927.350386:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.350399:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.350421:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98feada8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af64 expref: 179 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.350435:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.350437:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.350443:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af6b expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.350453:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af6b expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.350490:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e296600/0x557988ac98feadaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af6b expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074927.350504:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b57ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626630784:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074927.350653:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160436cf300 going to sleep for 11 seconds 00000100:00100000:0.0:1769074927.353442:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b57ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626630784:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074927.353472:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074927.353563:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2420:x1855007616137600:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3188us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.353573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1907 00000100:00100000:2.0:1769074927.374511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.374628:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137856 00000100:00100000:3.0:1769074927.374640:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137856 00000100:00100000:3.0:1769074927.374706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1892 00000100:00100000:3.0:1769074927.374716:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+384:67566:x1855007616137856:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074927.375088:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67566:x1855007616137856:12345-192.168.204.32@tcp:35:cp.0 Request processed in 372us (586us total) trans 4294969073 rc 0/0 00000100:00100000:3.0:1769074927.375097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1892 00000100:00100000:3.0:1769074927.426443:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.426626:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616137984 00000100:00100000:1.0:1769074927.426638:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616137984 00000100:00100000:1.0:1769074927.426708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9548 00000100:00100000:1.0:1769074927.426719:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67569:x1855007616137984:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074927.426740:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.426761:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feadb6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af72 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.426832:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.426847:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426858:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426875:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.426881:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426888:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426941:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426949:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426955:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426960:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.426964:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426971:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.426994:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.426998:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.427004:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427009:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feadbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427024:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427029:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427034:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427038:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.427040:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427045:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427051:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604e2b2a00) 00010000:00010000:1.0:1769074927.427054:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.427056:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427060:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feadc4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.427090:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feadb6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af72 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.427099:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.427101:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.427105:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feadb6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af72 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.427123:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297a00, rc 0) 00000100:00100000:1.0:1769074927.427191:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67569:x1855007616137984:12345-192.168.204.32@tcp:101:bash.0 Request processed in 473us (756us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.427198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9548 00000100:00100000:3.0:1769074927.443210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.443258:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.443617:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138112 00000100:00100000:0.0:1769074927.443630:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138112 00000100:00100000:0.0:1769074927.443691:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9549 00000100:00100000:0.0:1769074927.443701:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67570:x1855007616138112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.443729:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.443752:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feadcb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af79 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.443823:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.443838:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443849:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443864:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.443870:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443876:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443927:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443934:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443940:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443947:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.443952:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443960:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443981:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.443985:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.443989:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.443995:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feadd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444009:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444014:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444021:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444025:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.444028:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444034:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444040:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff916174963e00) 00010000:00010000:0.0:1769074927.444042:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.444045:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444050:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feadd9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.444079:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feadcb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af79 expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.444088:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.444091:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.444094:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feadcb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af79 expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.444103:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.444170:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67570:x1855007616138112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 470us (971us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.444177:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9549 00000100:00100000:2.0:1769074927.444941:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138240 00000100:00100000:2.0:1769074927.444947:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138240 00000100:00100000:2.0:1769074927.444995:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:2.0:1769074927.445003:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2419:x1855007616138240:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074927.445050:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.445062:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98feade0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2af80 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.445102:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074927.445122:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445131:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445147:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074927.445154:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445160:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445194:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445200:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445206:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445212:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.445215:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445222:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445230:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.445233:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.445237:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445242:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98feade7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445253:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445259:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445265:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445269:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.445283:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445289:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445296:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604e63ce00) 00010000:00010000:2.0:1769074927.445298:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.445301:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445306:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feadee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074927.445328:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98feade0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af80 expref: 386 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.445336:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.445339:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074927.445342:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98feade0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2af80 expref: 386 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.445350:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc -2) 00000100:00100000:2.0:1769074927.445400:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2419:x1855007616138240:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 397us (2141us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074927.445408:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:1.0:1769074927.448046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.448241:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138368 00000100:00100000:3.0:1769074927.448251:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138368 00000100:00100000:3.0:1769074927.448314:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9550 00000100:00100000:3.0:1769074927.448325:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67570:x1855007616138368:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074927.448344:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.448364:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feadf5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2afb8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.448431:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.448444:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448456:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448470:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.448477:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448483:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448568:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448576:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448582:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448587:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.448591:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448601:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448612:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.448615:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.448620:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448625:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feadfc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448637:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448643:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448648:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448653:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.448655:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448661:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448667:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604f135400) 00010000:00010000:3.0:1769074927.448669:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.448672:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448677:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae03 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.448709:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feadf5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afb8 expref: 386 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.448719:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.448722:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.448726:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feadf5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afb8 expref: 386 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.448734:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074927.448793:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67570:x1855007616138368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 470us (756us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.448800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9550 00000100:00100000:0.0:1769074927.465778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.466193:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138496 00000100:00100000:1.0:1769074927.466204:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138496 00000100:00100000:1.0:1769074927.466267:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9551 00000100:00100000:1.0:1769074927.466277:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67573:x1855007616138496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.466298:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.466320:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feae0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2afbf expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.466390:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.466406:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466417:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466434:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.466441:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466454:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466505:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466513:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466520:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466526:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.466575:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466584:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466596:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.466599:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.466604:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466610:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98feae11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466624:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466630:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466634:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466639:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.466642:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466647:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466653:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604e2b2a00) 00010000:00010000:1.0:1769074927.466655:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.466658:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466663:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98feae18 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.466697:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feae0a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afbf expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.466708:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.466711:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.466715:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98feae0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afbf expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.466723:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074927.466851:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67573:x1855007616138496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 574us (1082us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.466858:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9551 00000100:00100000:3.0:1769074927.466970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.467553:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138624 00000100:00100000:0.0:1769074927.467562:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138624 00000100:00100000:0.0:1769074927.467609:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:0.0:1769074927.467617:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2419:x1855007616138624:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074927.467666:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.467680:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feae1f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2afc6 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.467719:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074927.467731:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467739:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467752:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074927.467759:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467765:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467801:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467808:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467815:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467821:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.467825:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467831:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467842:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.467845:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.467848:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467854:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feae26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467866:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467872:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467877:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467883:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.467886:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467892:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467899:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff916174963e00) 00010000:00010000:0.0:1769074927.467902:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.467905:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467911:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feae2d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.467932:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feae1f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afc6 expref: 386 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.467941:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.467943:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074927.467947:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feae1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2afc6 expref: 386 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.467957:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc -2) 00000100:00100000:0.0:1769074927.468106:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:2419:x1855007616138624:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 488us (1143us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074927.468126:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:3.0:1769074927.473967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.474073:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616138752 00000100:00100000:1.0:1769074927.474086:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616138752 00000100:00100000:1.0:1769074927.474161:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9552 00000100:00100000:1.0:1769074927.474171:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67573:x1855007616138752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.474196:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.474234:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feae34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2affe expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.474335:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.474352:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474363:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474378:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074927.474384:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474390:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474450:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474457:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474463:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474469:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.474474:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474482:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474494:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.474497:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.474502:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474508:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feae3b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474522:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474578:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474585:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474590:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.474593:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474599:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474607:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604e2b2f00) 00010000:00010000:1.0:1769074927.474610:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.474613:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474624:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feae42 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074927.474659:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feae34 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2affe expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.474669:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.474671:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.474675:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98feae34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2affe expref: 386 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.474685:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297e00, rc 0) 00000100:00100000:1.0:1769074927.474744:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67573:x1855007616138752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 574us (792us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.474752:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9552 00000100:00100000:1.0:1769074927.483607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.483861:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139008 00000100:00100000:3.0:1769074927.483872:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139008 00000100:00100000:3.0:1769074927.483933:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9553 00000100:00100000:3.0:1769074927.483944:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+385:67573:x1855007616139008:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.483966:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.483999:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae49 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b005 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.484130:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.484144:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484160:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484176:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.484183:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484190:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:3.0:1769074927.484643:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc0:0x0], index 0: 0 00010000:00010000:3.0:1769074927.484799:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feae5e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.484810:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feae5e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484817:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feae5e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484850:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484857:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484864:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484870:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.484874:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484882:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484895:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.484898:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.484903:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484909:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feae50 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:3.0:1769074927.484921:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ddffbf60 reply state 0000000056bb32e5 transno 4294969074 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484931:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.484938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604f135400) 00010000:00010000:3.0:1769074927.484940:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074927.484943:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074927.484973:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feae49 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b005 expref: 388 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.484986:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45c00/0x557988ac98feae5e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b005 expref: 387 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.484993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18a:0x0].0x0 (ffff91604f135000) 00010000:00010000:3.0:1769074927.484996:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074927.484998:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45c00, rc 0) 00000100:00100000:3.0:1769074927.485220:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67573:x1855007616139008:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1276us (1620us total) trans 4294969074 rc 0/0 00000100:00100000:3.0:1769074927.485232:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9553 00000100:00100000:2.0:1769074927.494733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.494852:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139136 00000100:00100000:1.0:1769074927.494862:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139136 00000100:00100000:1.0:1769074927.494925:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2761 00000100:00100000:1.0:1769074927.494935:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2417:x1855007616139136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.494952:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.494983:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b00c expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074927.495008:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074927.495030:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.495032:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.495042:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.495057:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 178 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.495070:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c600, rc 0) 00000100:00100000:1.0:1769074927.495145:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2417:x1855007616139136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 210us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.495152:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2761 00000100:00100000:0.0:1769074927.498100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.498246:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139264 00000100:00100000:2.0:1769074927.498262:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139264 00000100:00100000:2.0:1769074927.498353:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2762 00000100:00100000:2.0:1769074927.498365:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67573:x1855007616139264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074927.498390:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.498414:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b013 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.498834:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074927.498846:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.498848:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.498853:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b013 expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.498901:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074927.498918:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 179 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:2.0:1769074927.498935:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b57ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626630912:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074927.501204:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160436cf300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074927.505586:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.506337:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139392 00000100:00100000:0.0:1769074927.506352:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139392 00010000:00010000:0.0:1769074927.506443:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 180 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:0.0:1769074927.506502:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1908 00000100:00100000:0.0:1769074927.506514:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616139392:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074927.506572:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074927.506602:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 180 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.506625:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 180 pid: 24564 timeout: 2016 lvb_type: 1 00010000:00010000:0.0:1769074927.506659:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.506662:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.506671:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b013 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.506682:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b013 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.506904:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b013 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074927.506924:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043581c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626631040:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074927.507047:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916045384900 going to sleep for 11 seconds 00010000:00010000:2.0:1769074927.507375:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c600/0x557988ac98feae6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b00c expref: 180 pid: 24564 timeout: 2016 lvb_type: 1 00000100:00100000:2.0:1769074927.507395:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b57ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626630912:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074927.507632:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281c00/0x557988ac98feae73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b013 expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.507644:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281c00, rc 0) 00000100:00100000:2.0:1769074927.507691:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67573:x1855007616139264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 9326us (9603us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074927.507700:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2762 00000100:00100000:2.0:1769074927.512247:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043581c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626631040:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074927.512296:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074927.512371:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2419:x1855007616139392:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5857us (6838us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074927.512384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1908 00000100:00100000:1.0:1769074927.514862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.514961:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139648 00000100:00100000:0.0:1769074927.514978:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139648 00000100:00100000:0.0:1769074927.515057:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1893 00000100:00100000:0.0:1769074927.515069:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67573:x1855007616139648:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074927.516038:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67573:x1855007616139648:12345-192.168.204.32@tcp:35:cp.0 Request processed in 965us (1179us total) trans 4294969075 rc 0/0 00000100:00100000:0.0:1769074927.516050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1893 00000100:00100000:1.0:1769074927.540421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.542341:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139776 00000100:00100000:2.0:1769074927.542361:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139776 00000100:00100000:2.0:1769074927.542468:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:2.0:1769074927.542481:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2420:x1855007616139776:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074927.542606:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.542641:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feae7a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b01a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.543381:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074927.543405:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543428:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543449:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074927.543457:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543464:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543578:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543587:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543594:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543601:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.543606:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543615:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543631:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.543636:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.543642:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543648:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feae81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543663:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543669:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543674:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543679:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.543682:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543687:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543693:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f135300) 00010000:00010000:3.0:1769074927.543696:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.543698:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543703:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae88 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.543756:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feae7a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b01a expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.543767:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.543770:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074927.543773:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feae7a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b01a expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.543784:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc -2) 00000100:00100000:3.0:1769074927.543889:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2420:x1855007616139776:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1409us (3481us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074927.543899:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:2.0:1769074927.560188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.560315:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616139904 00000100:00100000:3.0:1769074927.560330:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616139904 00000100:00100000:3.0:1769074927.560412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9554 00000100:00100000:3.0:1769074927.560434:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67580:x1855007616139904:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074927.560460:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.560488:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b052 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.560642:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.560660:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560674:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560692:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.560703:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560709:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560793:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560801:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560808:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560815:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.560819:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560827:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560841:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.560845:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.560851:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560858:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feae96 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560874:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560880:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560886:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560890:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.560893:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560898:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560904:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135300) 00010000:00010000:3.0:1769074927.560907:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.560909:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560914:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feae9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.560952:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae8f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b052 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.560963:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.560966:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.560970:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feae8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b052 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.560979:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45000, rc 0) 00000100:00100000:3.0:1769074927.561073:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67580:x1855007616139904:12345-192.168.204.32@tcp:101:bash.0 Request processed in 651us (903us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.561082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9554 00000100:00100000:1.0:1769074927.573118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.573464:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140032 00000100:00100000:0.0:1769074927.573479:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140032 00000100:00100000:0.0:1769074927.573812:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9555 00000100:00100000:0.0:1769074927.573825:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67581:x1855007616140032:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.573858:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.573892:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaea4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b059 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.573982:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.574000:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574013:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574032:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.574039:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574046:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574137:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574145:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574153:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574160:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.574166:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574174:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574189:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.574192:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.574198:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574204:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feaeab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574220:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574226:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574231:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574236:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.574239:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574244:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574251:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff916174963e00) 00010000:00010000:0.0:1769074927.574254:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.574257:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574267:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feaeb2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.574302:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaea4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b059 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.574313:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.574315:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.574319:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaea4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b059 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.574328:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc 0) 00000100:00100000:0.0:1769074927.574412:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67581:x1855007616140032:12345-192.168.204.32@tcp:101:rm.0 Request processed in 589us (1330us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.574422:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9555 00000100:00100000:2.0:1769074927.581590:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.581718:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140160 00000100:00100000:3.0:1769074927.581740:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140160 00000100:00100000:3.0:1769074927.581811:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:3.0:1769074927.581821:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2417:x1855007616140160:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074927.581873:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.581899:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaeb9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b060 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.581970:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074927.581990:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582003:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582019:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074927.582026:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582032:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582125:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582133:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582139:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582147:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604daa6c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.582152:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582160:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582174:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.582177:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.582183:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582197:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaec0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582211:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582217:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582223:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582227:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.582230:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582235:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582241:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604f135500) 00010000:00010000:3.0:1769074927.582243:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.582246:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582252:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaec7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074927.582288:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaeb9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b060 expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.582298:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.582300:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074927.582304:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaeb9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b060 expref: 390 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.582312:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4e00, rc -2) 00000100:00100000:3.0:1769074927.582397:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:2417:x1855007616140160:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 576us (821us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074927.582405:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:1.0:1769074927.587195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.587366:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140288 00000100:00100000:0.0:1769074927.587382:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140288 00000100:00100000:0.0:1769074927.587465:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9556 00000100:00100000:0.0:1769074927.587477:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67581:x1855007616140288:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.587507:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.587583:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaece lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b067 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.587678:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.587697:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587714:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587731:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.587739:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587746:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587816:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587825:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587831:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587838:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.587843:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587853:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587868:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.587871:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.587877:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587882:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaed5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587900:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587906:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587912:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587917:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.587920:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587926:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587933:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff916174963300) 00010000:00010000:0.0:1769074927.587936:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.587939:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587944:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaedc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.587977:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaece lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b067 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.587988:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.587990:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.587994:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaece lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b067 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.588011:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc 0) 00000100:00100000:0.0:1769074927.588083:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67581:x1855007616140288:12345-192.168.204.32@tcp:101:rm.0 Request processed in 608us (903us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.588587:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9556 00000100:00100000:2.0:1769074927.606051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.606309:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140416 00000100:00100000:3.0:1769074927.606325:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140416 00000100:00100000:3.0:1769074927.606403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9557 00000100:00100000:3.0:1769074927.606416:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67582:x1855007616140416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.606443:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.606474:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaee3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b06e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.606628:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.606649:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606665:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606684:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.606691:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606697:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606781:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606789:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606797:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606804:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.606809:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606819:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.606840:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.606846:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606852:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaeea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606869:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606876:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606881:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606885:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.606888:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606893:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606899:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135500) 00010000:00010000:3.0:1769074927.606902:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.606904:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606910:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaef1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.606951:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaee3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b06e expref: 390 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.606963:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.606965:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.606969:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaee3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b06e expref: 390 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.606984:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91617f988a00, rc 0) 00000100:00100000:3.0:1769074927.607059:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67582:x1855007616140416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 646us (1024us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.607068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9557 00000100:00100000:1.0:1769074927.613620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.613739:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140544 00000100:00100000:0.0:1769074927.613754:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140544 00000100:00100000:0.0:1769074927.613830:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9558 00000100:00100000:0.0:1769074927.613843:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67582:x1855007616140544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.613870:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.613898:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaef8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b075 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.613987:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.614006:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614020:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614037:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.614044:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614051:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614147:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614155:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614161:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614168:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.614173:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614181:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614195:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.614199:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.614204:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614211:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaeff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614226:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614232:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614237:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614242:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.614246:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614251:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614257:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff916174963300) 00010000:00010000:0.0:1769074927.614259:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.614262:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614267:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf06 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.614316:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaef8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b075 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.614327:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.614329:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.614333:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feaef8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b075 expref: 390 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.614343:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc 0) 00000100:00100000:0.0:1769074927.614425:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67582:x1855007616140544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 584us (820us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.614434:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9558 00000100:00100000:1.0:1769074927.618514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.618672:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140800 00000100:00100000:3.0:1769074927.618687:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140800 00000100:00100000:3.0:1769074927.618766:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9559 00000100:00100000:3.0:1769074927.618778:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+389:67582:x1855007616140800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.618807:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.618835:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaf0d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b07c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.618999:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.619019:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619032:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619049:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x1076a11c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.619056:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619062:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:3.0:1769074927.619493:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc1:0x0], index 1: 0 00010000:00010000:3.0:1769074927.619733:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaf22 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.619743:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaf22 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619751:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaf22 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619789:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619797:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619803:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619809:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.619814:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619821:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.619838:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.619845:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619851:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf14 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:3.0:1769074927.619869:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c12b1bc7 reply state 00000000e28eea13 transno 4294969076 ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619881:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.619887:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135500) 00010000:00010000:3.0:1769074927.619889:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074927.619892:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074927.619929:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaf0d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b07c expref: 392 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.619946:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604daa6c00/0x557988ac98feaf22 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b07c expref: 391 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.619953:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18b:0x0].0x0 (ffff91604f135300) 00010000:00010000:3.0:1769074927.619955:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074927.619958:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604daa6c00, rc 0) 00000100:00100000:3.0:1769074927.620042:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67582:x1855007616140800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1265us (1557us total) trans 4294969076 rc 0/0 00000100:00100000:3.0:1769074927.620049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9559 00000100:00100000:2.0:1769074927.626106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.626229:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616140928 00000100:00100000:0.0:1769074927.626245:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616140928 00000100:00100000:0.0:1769074927.626334:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2763 00000100:00100000:0.0:1769074927.626345:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2420:x1855007616140928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.626375:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.626405:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b083 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074927.626438:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074927.626469:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.626471:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.626482:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.626502:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.626518:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc 0) 00000100:00100000:0.0:1769074927.626634:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616140928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 289us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.626641:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2763 00000100:00100000:1.0:1769074927.631042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.631265:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141056 00000100:00100000:2.0:1769074927.631291:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141056 00000100:00100000:2.0:1769074927.631373:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2764 00000100:00100000:2.0:1769074927.631385:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67582:x1855007616141056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074927.631410:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.631434:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b08a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.631477:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074927.631487:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.631489:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.631494:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b08a expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.631588:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074927.631605:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:2.0:1769074927.631622:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626631168:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074927.632925:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160436cf300 going to sleep for 11 seconds 00000100:00100000:1.0:1769074927.635662:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626631168:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074927.635713:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b08a expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.635739:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280800, rc 0) 00000100:00100000:1.0:1769074927.635822:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67582:x1855007616141056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4438us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.635833:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2764 00000100:00100000:1.0:1769074927.638251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.638899:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141184 00000100:00100000:2.0:1769074927.638914:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141184 00010000:00010000:2.0:1769074927.638992:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 2016 lvb_type: 1 00000100:00100000:2.0:1769074927.639103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1909 00000100:00100000:2.0:1769074927.639124:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2420:x1855007616141184:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074927.639144:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074927.639171:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.639187:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.639218:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916174a49c00/0x557988ac98feaf30 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b083 expref: 180 pid: 25313 timeout: 2016 lvb_type: 1 00010000:00010000:2.0:1769074927.639244:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.639247:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074927.639257:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b08a expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.639281:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b08a expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.639340:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e280800/0x557988ac98feaf37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b08a expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074927.639360:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626631296:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074927.639488:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160436cf300 going to sleep for 11 seconds 00000100:00100000:2.0:1769074927.652943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.653073:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626631296:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074927.653127:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074927.653208:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616141184:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 14085us (14969us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.653222:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1909 00000100:00100000:1.0:1769074927.654296:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141440 00000100:00100000:1.0:1769074927.654311:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141440 00000100:00100000:1.0:1769074927.654387:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1894 00000100:00100000:1.0:1769074927.654399:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67582:x1855007616141440:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074927.655031:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67582:x1855007616141440:12345-192.168.204.32@tcp:35:cp.0 Request processed in 632us (2103us total) trans 4294969077 rc 0/0 00000100:00100000:1.0:1769074927.655041:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1894 00000100:00100000:3.0:1769074927.713764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.713918:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141568 00000100:00100000:0.0:1769074927.713933:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141568 00000100:00100000:0.0:1769074927.714013:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9560 00000100:00100000:0.0:1769074927.714025:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67586:x1855007616141568:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074927.714054:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.714083:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b091 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.714204:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.714230:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714246:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714264:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.714284:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714291:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714359:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714368:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714375:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714382:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.714387:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714396:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714410:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.714413:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.714420:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714426:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf45 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714442:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714448:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714454:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714459:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.714462:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714468:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714475:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff916174963500) 00010000:00010000:0.0:1769074927.714478:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.714480:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714486:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf4c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.714587:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf3e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b091 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.714599:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.714602:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.714605:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b091 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.714617:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48e00, rc 0) 00000100:00100000:0.0:1769074927.714711:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67586:x1855007616141568:12345-192.168.204.32@tcp:101:bash.0 Request processed in 687us (962us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.714729:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9560 00000100:00100000:1.0:1769074927.726011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.726154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.726249:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141824 00000100:00100000:0.0:1769074927.726264:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141824 00000100:00100000:0.0:1769074927.726353:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:0.0:1769074927.726365:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:2417:x1855007616141824:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074927.726422:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.726449:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf53 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b09f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.726562:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074927.726582:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726596:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726615:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074927.726622:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726629:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726702:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726710:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726730:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726737:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.726742:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726751:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726766:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.726770:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.726775:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726782:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feaf5a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726799:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726804:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726809:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726814:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.726817:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726822:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726828:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff916174963500) 00010000:00010000:0.0:1769074927.726830:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.726833:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726838:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feaf61 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074927.726871:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf53 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b09f expref: 394 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.726882:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.726884:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074927.726888:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feaf53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b09f expref: 394 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.726896:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48e00, rc -2) 00000100:00100000:0.0:1769074927.726989:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:2417:x1855007616141824:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 626us (835us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074927.726999:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:3.0:1769074927.729403:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141696 00000100:00100000:3.0:1769074927.729426:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141696 00000100:00100000:3.0:1769074927.730120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9561 00000100:00100000:3.0:1769074927.730138:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67587:x1855007616141696:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074927.730166:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.730196:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaf68 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b098 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.730303:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.730321:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730333:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730352:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.730360:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730367:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730434:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730442:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730449:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730456:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f988a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.730461:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730469:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730487:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.730824:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.730833:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730840:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f988a00/0x557988ac98feaf6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730856:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730861:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730866:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730872:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.730875:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730880:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730889:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff91604f135900) 00010000:00010000:3.0:1769074927.730891:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.730894:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730899:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45000/0x557988ac98feaf76 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.730939:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaf68 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b098 expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.730950:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.730953:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.730956:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4e00/0x557988ac98feaf68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b098 expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.730965:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1d4e00, rc 0) 00000100:00100000:3.0:1769074927.731157:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67587:x1855007616141696:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1024us (5160us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.731166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9561 00000100:00100000:1.0:1769074927.740256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.740446:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616141952 00000100:00100000:3.0:1769074927.740461:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616141952 00000100:00100000:3.0:1769074927.740917:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9562 00000100:00100000:3.0:1769074927.740931:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67587:x1855007616141952:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074927.740958:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.740986:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaf7d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.741084:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.741197:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741213:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741261:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.741370:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741378:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741451:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741460:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741467:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741474:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.741479:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741488:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741660:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.741665:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.741671:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741679:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45600/0x557988ac98feaf84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741695:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741702:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741708:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741714:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.741798:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741807:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff91604f135600) 00010000:00010000:3.0:1769074927.741818:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.741821:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741827:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feaf8b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.741878:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaf7d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0a6 expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.741890:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.741893:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.741897:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45a00/0x557988ac98feaf7d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0a6 expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.741907:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a45a00, rc 0) 00000100:00100000:3.0:1769074927.742077:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67587:x1855007616141952:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1148us (1836us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.742097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9562 00000100:00100000:2.0:1769074927.755000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.755243:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142080 00000100:00100000:3.0:1769074927.755261:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142080 00000100:00100000:3.0:1769074927.755356:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9563 00000100:00100000:3.0:1769074927.755369:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67588:x1855007616142080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.755406:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.755437:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaf92 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.755581:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.755600:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755614:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755631:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.755638:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755644:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755716:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755725:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755733:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755743:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.755748:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755758:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755773:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.755777:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.755783:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755790:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaf99 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755806:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755812:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755817:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755822:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.755825:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755830:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755838:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff91604f135900) 00010000:00010000:3.0:1769074927.755841:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.755844:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755849:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafa0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.755888:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaf92 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0ad expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.755898:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.755901:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.755905:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaf92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0ad expref: 394 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.755916:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc 0) 00000100:00100000:3.0:1769074927.755990:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67588:x1855007616142080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 623us (1002us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.755998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9563 00000100:00100000:2.0:1769074927.760034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.760266:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142208 00000100:00100000:0.0:1769074927.760287:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142208 00000100:00100000:0.0:1769074927.760362:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9564 00000100:00100000:0.0:1769074927.760373:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67588:x1855007616142208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.760402:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.760430:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feafa7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0b4 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.761045:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.761065:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761078:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761184:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.761193:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761200:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761354:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761362:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761370:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761376:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.761382:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761394:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761410:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.761413:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.761420:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761426:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feafae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761440:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761446:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761452:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761457:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.761459:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761465:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761472:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff916174963500) 00010000:00010000:0.0:1769074927.761475:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.761477:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761482:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feafb5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.761655:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feafa7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0b4 expref: 394 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.761667:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.761669:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.761673:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48e00/0x557988ac98feafa7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0b4 expref: 394 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.761684:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48e00, rc 0) 00000100:00100000:0.0:1769074927.761770:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67588:x1855007616142208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1397us (1748us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.761780:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9564 00000100:00100000:1.0:1769074927.766880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.766981:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142464 00000100:00100000:0.0:1769074927.766996:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142464 00000100:00100000:0.0:1769074927.767071:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9565 00000100:00100000:0.0:1769074927.767084:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+393:67588:x1855007616142464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.767127:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.767156:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feafbc lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0bb expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.767326:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.767344:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.767356:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.767378:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.767385:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.767391:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074927.767780:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc1:0x0], index 0: 0 00010000:00010000:0.0:1769074927.767943:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feafd1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.767953:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feafd1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.767960:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feafd1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.767996:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768003:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768010:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768016:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.768021:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768028:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768042:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.768045:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.768050:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768055:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feafc3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074927.768069:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003ef5e1e3 reply state 0000000078cf21ef transno 4294969078 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768080:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.768086:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff916174a68a00) 00010000:00010000:0.0:1769074927.768088:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074927.768091:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074927.768135:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feafbc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0bb expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.768151:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49c00/0x557988ac98feafd1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0bb expref: 395 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.768158:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18c:0x0].0x0 (ffff91604f42ab00) 00010000:00010000:0.0:1769074927.768161:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074927.768163:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49c00, rc 0) 00000100:00100000:0.0:1769074927.768240:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67588:x1855007616142464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1158us (1379us total) trans 4294969078 rc 0/0 00000100:00100000:0.0:1769074927.768248:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9565 00000100:00100000:2.0:1769074927.773514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.773732:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142592 00000100:00100000:1.0:1769074927.773747:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142592 00000100:00100000:1.0:1769074927.773835:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2765 00000100:00100000:1.0:1769074927.773848:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2420:x1855007616142592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074927.773875:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.773904:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0c2 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074927.773937:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074927.773964:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.773967:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.773978:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.774000:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074927.774017:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d600, rc 0) 00000100:00100000:1.0:1769074927.774104:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616142592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 258us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.774122:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2765 00000100:00100000:1.0:1769074927.777756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.777913:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142720 00000100:00100000:0.0:1769074927.777929:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142720 00000100:00100000:0.0:1769074927.778035:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2766 00000100:00100000:0.0:1769074927.778047:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67588:x1855007616142720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.778073:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.778117:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0c9 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.778157:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.778166:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.778169:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.778173:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c9 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.778218:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.778233:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074927.778250:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626631424:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074927.778391:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151c29480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074927.781010:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626631424:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074927.781064:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c9 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.781114:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48e00, rc 0) 00000100:00100000:0.0:1769074927.781177:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67588:x1855007616142720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3132us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.781187:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2766 00000100:00100000:2.0:1769074927.784065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.784258:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616142848 00000100:00100000:1.0:1769074927.784284:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616142848 00010000:00010000:1.0:1769074927.784366:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:1.0:1769074927.784417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1910 00000100:00100000:1.0:1769074927.784429:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616142848:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074927.784448:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074927.784479:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:1.0:1769074927.784506:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:1.0:1769074927.784963:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d600/0x557988ac98feafdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c2 expref: 180 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:1.0:1769074927.784994:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.784997:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074927.785006:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c9 expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.785018:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c9 expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.785075:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48e00/0x557988ac98feafe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0c9 expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074927.785172:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626631552:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074927.785359:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47540 going to sleep for 11 seconds 00000100:00100000:1.0:1769074927.790054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.790253:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143104 00000100:00100000:3.0:1769074927.790268:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143104 00000100:00100000:3.0:1769074927.790347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1895 00000100:00100000:3.0:1769074927.790359:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67588:x1855007616143104:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074927.790784:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67588:x1855007616143104:12345-192.168.204.32@tcp:35:cp.0 Request processed in 426us (745us total) trans 4294969079 rc 0/0 00000100:00100000:3.0:1769074927.790793:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1895 00000100:00100000:2.0:1769074927.791130:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626631552:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074927.791163:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074927.791203:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616142848:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6776us (7153us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074927.791213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1910 00010000:00010000:0.0:1769074927.796011:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769074927.830711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.830961:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143232 00000100:00100000:3.0:1769074927.830974:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143232 00000100:00100000:3.0:1769074927.831035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9566 00000100:00100000:3.0:1769074927.831044:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67591:x1855007616143232:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074927.831072:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.831117:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.831204:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.831221:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831234:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831248:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074927.831255:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831261:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831336:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831343:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831349:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831355:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.831359:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831371:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831384:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.831388:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.831394:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831400:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feaff4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831412:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831425:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831430:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831435:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074927.831438:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831444:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604f135900) 00010000:00010000:3.0:1769074927.831453:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.831456:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831462:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9800/0x557988ac98feaffb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074927.831496:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0d0 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.831506:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074927.831509:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074927.831700:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feafed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0d0 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.831712:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074927.831806:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67591:x1855007616143232:12345-192.168.204.32@tcp:101:bash.0 Request processed in 761us (1110us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074927.831814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9566 00000100:00100000:3.0:1769074927.845201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.845579:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143488 00000100:00100000:1.0:1769074927.845595:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143488 00000100:00100000:1.0:1769074927.845664:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 213 00000100:00100000:1.0:1769074927.845675:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:2420:x1855007616143488:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074927.845743:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.845770:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb002 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0de expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.845847:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074927.845866:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845881:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845896:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074927.845902:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845908:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845978:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845985:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845993:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.845999:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.846004:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846013:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846027:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.846030:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.846036:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846042:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb009 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846060:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846066:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846072:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846076:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.846079:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846175:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846185:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff91604e2b2500) 00010000:00010000:1.0:1769074927.846188:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.846191:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846202:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb010 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.846239:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb002 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0de expref: 398 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.846249:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.846251:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074927.846255:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb002 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0de expref: 398 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.846284:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48cc00, rc -2) 00000100:00100000:1.0:1769074927.846380:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:2420:x1855007616143488:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 707us (1194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074927.846389:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 213 00000100:00100000:1.0:1769074927.849205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.850693:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143360 00000100:00100000:0.0:1769074927.850713:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143360 00000100:00100000:0.0:1769074927.850812:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9567 00000100:00100000:0.0:1769074927.850826:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67592:x1855007616143360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.850856:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.850886:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb017 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0d7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.850983:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.851003:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851015:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851030:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.851034:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851038:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851115:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851122:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851128:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851135:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.851140:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851148:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851163:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.851166:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.851173:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851179:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb01e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851191:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851194:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851198:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851201:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.851204:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851208:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851212:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff916174963500) 00010000:00010000:0.0:1769074927.851213:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.851215:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851218:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb025 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.851247:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb017 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0d7 expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.851255:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.851256:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.851258:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb017 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0d7 expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.851264:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc 0) 00000100:00100000:0.0:1769074927.851359:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67592:x1855007616143360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 535us (2166us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.851368:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9567 00000100:00100000:2.0:1769074927.854488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.854835:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143616 00000100:00100000:0.0:1769074927.854848:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143616 00000100:00100000:0.0:1769074927.854913:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9568 00000100:00100000:0.0:1769074927.854925:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67592:x1855007616143616:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.854956:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.854982:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb02c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0e5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.855052:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.855067:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855077:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855089:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.855095:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855101:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855184:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855189:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855193:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855197:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.855200:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855209:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855221:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.855223:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.855227:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855231:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb033 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855241:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855245:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855249:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855251:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.855253:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855256:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855259:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604f8b3000) 00010000:00010000:0.0:1769074927.855260:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.855262:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855265:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb03a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.855323:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb02c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0e5 expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.855334:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.855337:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.855340:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb02c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0e5 expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.855351:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.855430:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67592:x1855007616143616:12345-192.168.204.32@tcp:101:rm.0 Request processed in 493us (940us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.855438:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9568 00000100:00100000:3.0:1769074927.872702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.872900:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143744 00000100:00100000:0.0:1769074927.872916:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143744 00000100:00100000:0.0:1769074927.872995:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9569 00000100:00100000:0.0:1769074927.873007:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67593:x1855007616143744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.873037:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.873067:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb041 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0ec expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.873170:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.873189:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873203:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873225:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.873232:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873239:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873323:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873331:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873338:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873344:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.873349:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873358:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873372:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.873375:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.873381:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873386:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb048 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873403:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873410:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873416:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873420:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.873423:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873429:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873437:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604f8b3000) 00010000:00010000:0.0:1769074927.873439:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.873442:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873448:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb04f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.873488:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb041 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0ec expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.873499:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.873502:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.873505:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb041 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0ec expref: 398 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.873607:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7400, rc 0) 00000100:00100000:0.0:1769074927.873693:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67593:x1855007616143744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 688us (1007us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.873703:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9569 00000100:00100000:1.0:1769074927.877198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.877314:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616143872 00000100:00100000:3.0:1769074927.877328:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616143872 00000100:00100000:3.0:1769074927.877401:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9570 00000100:00100000:3.0:1769074927.877412:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67593:x1855007616143872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.877439:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.877470:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb056 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0f3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.878400:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.878425:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878440:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878457:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.878464:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878471:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878701:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878710:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878794:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878801:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.878806:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878814:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878830:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.878834:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.878841:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878848:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb05d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878865:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878871:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878876:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878881:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.878884:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878889:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878896:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604e63ce00) 00010000:00010000:2.0:1769074927.878900:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.878903:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878909:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb064 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.878957:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb056 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0f3 expref: 398 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.878969:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.878972:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.878976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb056 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0f3 expref: 398 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.878987:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:2.0:1769074927.879160:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67593:x1855007616143872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1747us (1976us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074927.879169:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9570 00000100:00100000:1.0:1769074927.883900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.884001:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144128 00000100:00100000:2.0:1769074927.884016:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144128 00000100:00100000:2.0:1769074927.884133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9571 00000100:00100000:2.0:1769074927.884146:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+397:67593:x1855007616144128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074927.884178:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.884209:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb06b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b0fa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.884472:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.884697:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.884713:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.884815:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x490495a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.884824:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.884831:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:2.0:1769074927.885376:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc2:0x0], index 1: 0 00010000:00010000:2.0:1769074927.885683:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281200/0x557988ac98feb080 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.885697:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281200/0x557988ac98feb080 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885706:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281200/0x557988ac98feb080 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885834:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885842:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885849:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885855:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.885859:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885866:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885881:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.885884:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.885889:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885895:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb072 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:2.0:1769074927.885915:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c23f3698 reply state 00000000447072b4 transno 4294969080 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885927:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.885933:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604e63cf00) 00010000:00010000:2.0:1769074927.885936:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074927.885940:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074927.885985:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb06b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0fa expref: 400 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.886002:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281200/0x557988ac98feb080 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b0fa expref: 399 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.886010:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18d:0x0].0x0 (ffff91604e63c000) 00010000:00010000:2.0:1769074927.886013:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074927.886016:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281200, rc 0) 00000100:00100000:2.0:1769074927.886208:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67593:x1855007616144128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2063us (2323us total) trans 4294969080 rc 0/0 00000100:00100000:2.0:1769074927.886218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9571 00000100:00100000:1.0:1769074927.891027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.891140:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144256 00000100:00100000:0.0:1769074927.891156:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144256 00000100:00100000:0.0:1769074927.891236:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2767 00000100:00100000:0.0:1769074927.891249:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616144256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.891285:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.891319:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b101 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074927.891350:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074927.891376:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.891378:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.891390:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 180 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.891411:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 180 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074927.891427:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074927.891520:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616144256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 273us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.891565:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2767 00000100:00100000:1.0:1769074927.894961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074927.895079:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144384 00000100:00100000:3.0:1769074927.895095:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144384 00000100:00100000:3.0:1769074927.895179:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2768 00000100:00100000:3.0:1769074927.895192:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67593:x1855007616144384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074927.895222:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074927.895246:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b108 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.895299:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074927.895309:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074927.895312:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074927.895318:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b108 expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074927.895367:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074927.895386:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 181 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:3.0:1769074927.895405:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f973800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626631680:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074927.895580:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161473eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074927.899333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.899703:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144512 00000100:00100000:0.0:1769074927.899728:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144512 00010000:00010000:0.0:1769074927.899802:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074927.899852:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1911 00000100:00100000:0.0:1769074927.899863:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616144512:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074927.899881:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074927.899909:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074927.899926:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074927.899959:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.899962:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074927.899971:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b108 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.899981:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b108 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.900027:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b108 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074927.900042:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626631808:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074927.900167:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916151c29480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074927.903785:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626631808:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074927.903827:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074927.903907:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616144512:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4043us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074927.903920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1911 00010000:00010000:1.0:1769074927.905896:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916174a48a00/0x557988ac98feb08e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b101 expref: 181 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:1.0:1769074927.905925:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f973800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626631680:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074927.905964:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9800/0x557988ac98feb095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b108 expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.905985:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9800, rc 0) 00000100:00100000:1.0:1769074927.906225:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67593:x1855007616144384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11035us (11278us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074927.906236:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2768 00000100:00100000:2.0:1769074927.909902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.910026:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144768 00000100:00100000:0.0:1769074927.910039:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144768 00000100:00100000:0.0:1769074927.910162:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1896 00000100:00100000:0.0:1769074927.910175:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67593:x1855007616144768:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074927.910933:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67593:x1855007616144768:12345-192.168.204.32@tcp:35:cp.0 Request processed in 755us (1040us total) trans 4294969081 rc 0/0 00000100:00100000:0.0:1769074927.910944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1896 00000100:00100000:2.0:1769074927.942080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.942222:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616144896 00000100:00100000:1.0:1769074927.942238:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616144896 00000100:00100000:1.0:1769074927.942473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9572 00000100:00100000:1.0:1769074927.942486:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67596:x1855007616144896:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074927.942578:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.942611:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb09c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b10f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.942711:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.942922:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.942937:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.942954:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074927.942961:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.942967:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943043:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943050:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943057:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943064:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.943069:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943081:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943095:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.943099:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.943115:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943121:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943138:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943144:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943150:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943155:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.943158:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943165:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943172:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604e2b2500) 00010000:00010000:1.0:1769074927.943174:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.943177:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074927.943226:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb09c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b10f expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.943238:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.943240:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.943244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb09c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b10f expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.943254:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074927.943487:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67596:x1855007616144896:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1003us (1423us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074927.943505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9572 00000100:00100000:1.0:1769074927.961311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.961491:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145024 00000100:00100000:2.0:1769074927.961505:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145024 00000100:00100000:2.0:1769074927.961619:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9573 00000100:00100000:2.0:1769074927.961630:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67597:x1855007616145024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074927.961666:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.961696:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb0b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b116 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.961793:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.961812:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961826:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961843:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.961849:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961856:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961932:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961940:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961947:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961953:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.961958:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961967:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961983:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.961987:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.961993:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.961999:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb0b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962014:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962020:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962026:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962031:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.962034:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962039:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604e63ce00) 00010000:00010000:2.0:1769074927.962049:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.962051:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962057:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb0bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.962094:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb0b1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b116 expref: 402 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.962115:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.962117:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.962121:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb0b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b116 expref: 402 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.962132:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074927.962222:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67597:x1855007616145024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 594us (926us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074927.962231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9573 00000100:00100000:2.0:1769074927.966234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074927.966409:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145152 00000100:00100000:1.0:1769074927.966422:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145152 00000100:00100000:1.0:1769074927.966507:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:1.0:1769074927.966520:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:2417:x1855007616145152:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074927.966599:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074927.966626:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b11d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.966702:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074927.966730:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966742:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966759:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074927.966765:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966771:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966842:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966850:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966856:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966862:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.966867:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966876:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966889:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.966892:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.966897:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966903:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb0cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966920:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966927:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966932:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966936:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074927.966939:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966945:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966950:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604e2b2500) 00010000:00010000:1.0:1769074927.966952:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074927.966955:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966960:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb0d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074927.966990:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b11d expref: 402 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.967001:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074927.967003:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074927.967006:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb0c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b11d expref: 402 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074927.967015:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d000, rc -2) 00000100:00100000:1.0:1769074927.967116:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:2417:x1855007616145152:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 588us (888us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074927.967126:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:1.0:1769074927.970484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.970600:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145280 00000100:00100000:0.0:1769074927.970613:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145280 00000100:00100000:0.0:1769074927.970690:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9574 00000100:00100000:0.0:1769074927.970703:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67597:x1855007616145280:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074927.970736:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.970762:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b124 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.970843:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.970859:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970871:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970887:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.970898:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970904:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970970:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970977:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970985:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.970992:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.970997:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971006:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971020:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.971024:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.971029:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971036:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971051:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971056:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971063:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971068:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.971071:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971077:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971084:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f15f100) 00010000:00010000:0.0:1769074927.971086:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.971089:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971094:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0e9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.971142:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0db lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b124 expref: 402 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.971153:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.971156:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.971159:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b124 expref: 402 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.971169:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc 0) 00000100:00100000:0.0:1769074927.971251:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67597:x1855007616145280:12345-192.168.204.32@tcp:101:rm.0 Request processed in 551us (782us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.971260:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9574 00000100:00100000:3.0:1769074927.988672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.988814:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145408 00000100:00100000:0.0:1769074927.988828:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145408 00000100:00100000:0.0:1769074927.988912:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9575 00000100:00100000:0.0:1769074927.988924:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67598:x1855007616145408:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.988953:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.988982:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b12b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.989074:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.989092:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989115:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989133:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.989141:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989147:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989218:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989227:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989233:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989241:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.989245:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989254:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989280:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.989284:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.989289:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989295:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb0f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989310:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989316:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989322:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989328:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074927.989330:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989336:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989343:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f15f100) 00010000:00010000:0.0:1769074927.989345:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.989348:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989354:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb0fe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.989393:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0f0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b12b expref: 402 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.989404:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074927.989408:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074927.989411:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb0f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b12b expref: 402 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.989421:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc 0) 00000100:00100000:0.0:1769074927.989515:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67598:x1855007616145408:12345-192.168.204.32@tcp:101:cp.0 Request processed in 593us (858us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074927.989525:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9575 00000100:00100000:1.0:1769074927.994045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074927.994176:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145536 00000100:00100000:2.0:1769074927.994191:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145536 00000100:00100000:2.0:1769074927.994279:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9576 00000100:00100000:2.0:1769074927.994292:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67598:x1855007616145536:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074927.994320:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074927.994346:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb105 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b132 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.994433:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.994453:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994466:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994482:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074927.994490:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994507:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994619:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994628:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994635:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994642:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.994647:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994655:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994669:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.994673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.994679:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994686:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb10c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994701:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994706:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994712:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994716:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074927.994719:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994725:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994731:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604e63ce00) 00010000:00010000:2.0:1769074927.994734:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.994736:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994742:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb113 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074927.994780:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb105 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b132 expref: 402 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.994791:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074927.994793:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074927.994797:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb105 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b132 expref: 402 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074927.994806:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074927.994889:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67598:x1855007616145536:12345-192.168.204.32@tcp:101:cp.0 Request processed in 600us (861us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074927.994898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9576 00000100:00100000:1.0:1769074927.998785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074927.998897:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145792 00000100:00100000:0.0:1769074927.998913:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145792 00000100:00100000:0.0:1769074927.998976:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9577 00000100:00100000:0.0:1769074927.998987:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+401:67598:x1855007616145792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074927.999013:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074927.999040:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb11a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b139 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074927.999207:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.999226:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.999239:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.999255:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.999262:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.999278:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074927.999800:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc2:0x0], index 0: 0 00010000:00010000:0.0:1769074927.999977:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb12f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074927.999990:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb12f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074927.999998:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb12f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000036:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000043:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000050:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000056:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.000061:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000070:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000085:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.000089:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.000095:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000111:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb121 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074928.000126:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005da06706 reply state 00000000b2915980 transno 4294969082 ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000138:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.000144:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f15f100) 00010000:00010000:0.0:1769074928.000147:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074928.000150:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074928.000189:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48000/0x557988ac98feb11a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b139 expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.000205:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48a00/0x557988ac98feb12f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b139 expref: 403 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.000212:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18e:0x0].0x0 (ffff91604f185900) 00010000:00010000:0.0:1769074928.000215:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074928.000217:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48a00, rc 0) 00000100:00100000:0.0:1769074928.000297:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67598:x1855007616145792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1311us (1526us total) trans 4294969082 rc 0/0 00000100:00100000:0.0:1769074928.000310:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9577 00000100:00100000:3.0:1769074928.004163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.004277:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616145920 00000100:00100000:1.0:1769074928.004291:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616145920 00000100:00100000:1.0:1769074928.004352:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2769 00000100:00100000:1.0:1769074928.004362:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616145920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.004384:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.004408:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b140 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074928.004439:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074928.004462:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.004465:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.004476:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.004495:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.004511:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074928.004631:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616145920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 269us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074928.004640:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2769 00000100:00100000:1.0:1769074928.007806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.008180:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146048 00000100:00100000:0.0:1769074928.008193:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146048 00000100:00100000:0.0:1769074928.008280:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2770 00000100:00100000:0.0:1769074928.008293:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67598:x1855007616146048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.008319:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.008345:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b147 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.008385:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.008395:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.008398:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.008403:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b147 expref: 181 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.008451:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.008466:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.008481:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626631936:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074928.009005:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074928.012765:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626631936:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074928.012813:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b147 expref: 181 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.012839:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48000, rc 0) 00000100:00100000:0.0:1769074928.012917:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67598:x1855007616146048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4626us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.012927:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2770 00000100:00100000:3.0:1769074928.014432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.014588:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146176 00000100:00100000:0.0:1769074928.014601:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146176 00010000:00010000:0.0:1769074928.014681:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.014735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1912 00000100:00100000:0.0:1769074928.014745:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616146176:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074928.014763:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074928.014792:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.014808:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.014841:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48da00/0x557988ac98feb13d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b140 expref: 181 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.014862:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.014865:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.014875:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b147 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.014886:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b147 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.014931:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48000/0x557988ac98feb144 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b147 expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074928.014946:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626632064:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074928.015065:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604a7f9240 going to sleep for 11 seconds 00000100:00100000:1.0:1769074928.020197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.020327:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626632064:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074928.020361:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074928.020435:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616146176:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5690us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.020448:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1912 00000100:00100000:2.0:1769074928.020786:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146432 00000100:00100000:2.0:1769074928.020797:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146432 00000100:00100000:2.0:1769074928.020858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1897 00000100:00100000:2.0:1769074928.020869:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67598:x1855007616146432:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074928.021252:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67598:x1855007616146432:12345-192.168.204.32@tcp:35:cp.0 Request processed in 384us (1070us total) trans 4294969083 rc 0/0 00000100:00100000:2.0:1769074928.021260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1897 00000100:00100000:1.0:1769074928.050233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.050354:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146560 00000100:00100000:2.0:1769074928.050368:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146560 00000100:00100000:2.0:1769074928.050446:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9578 00000100:00100000:2.0:1769074928.050458:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67601:x1855007616146560:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074928.050487:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.050526:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb14b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b14e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.050662:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.050682:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.050695:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.050709:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.051122:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051130:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051209:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051216:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051223:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051231:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.051240:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051249:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051261:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.051265:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.051270:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051276:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb152 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051292:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051297:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051302:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051306:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.051309:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051314:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051320:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff91604e63ce00) 00010000:00010000:2.0:1769074928.051322:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.051325:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb159 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.051370:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb14b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b14e expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.051380:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.051382:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.051386:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb14b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b14e expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.051394:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074928.051647:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67601:x1855007616146560:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1189us (1425us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.051656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9578 00000100:00100000:1.0:1769074928.061617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.061720:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146688 00000100:00100000:0.0:1769074928.061735:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146688 00000100:00100000:0.0:1769074928.061814:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9579 00000100:00100000:0.0:1769074928.061824:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67602:x1855007616146688:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.061856:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.061883:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb160 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b155 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.061972:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.061990:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062004:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062022:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.062028:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062034:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062115:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062122:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062128:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062134:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.062139:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062147:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062162:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.062165:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.062170:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062176:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb167 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062213:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062219:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062225:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062229:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.062232:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062237:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062244:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff916052af8400) 00010000:00010000:0.0:1769074928.062246:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.062249:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062254:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb16e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.062302:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb160 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b155 expref: 406 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.062312:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.062315:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.062318:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb160 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b155 expref: 406 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.062332:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc 0) 00000100:00100000:0.0:1769074928.062408:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67602:x1855007616146688:12345-192.168.204.32@tcp:101:rm.0 Request processed in 584us (806us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.062416:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9579 00000100:00100000:3.0:1769074928.066183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.066325:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146816 00000100:00100000:0.0:1769074928.066340:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146816 00000100:00100000:0.0:1769074928.066406:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:0.0:1769074928.066419:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:2417:x1855007616146816:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074928.066469:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.066500:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb175 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b15c expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.066611:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.066630:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066643:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066663:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.066670:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066677:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066765:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066774:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066781:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066788:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.066793:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066801:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066816:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.066820:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.066826:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066833:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb17c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066848:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066854:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066859:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066864:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.066867:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066872:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066879:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff916052af8500) 00010000:00010000:0.0:1769074928.066882:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.066884:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066889:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb183 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.066921:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb175 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b15c expref: 406 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.066931:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.066933:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074928.066937:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb175 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b15c expref: 406 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.066945:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc -2) 00000100:00100000:0.0:1769074928.067029:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:2417:x1855007616146816:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 612us (863us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074928.067038:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:1.0:1769074928.072857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.073018:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616146944 00000100:00100000:2.0:1769074928.073033:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616146944 00000100:00100000:2.0:1769074928.073118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9580 00000100:00100000:2.0:1769074928.073131:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67602:x1855007616146944:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074928.073164:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.073193:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb18a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b163 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.073300:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.073319:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073334:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073364:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.073372:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073379:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073451:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073460:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073467:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073474:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.073480:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073504:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073520:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.073523:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.073568:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073576:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb191 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073591:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073597:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073603:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073608:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.073611:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073617:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073625:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff91604e63ce00) 00010000:00010000:2.0:1769074928.073628:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.073631:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073637:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb198 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.073678:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb18a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b163 expref: 406 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.073689:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.073692:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.073696:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb18a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b163 expref: 406 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.073706:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074928.073794:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67602:x1855007616146944:12345-192.168.204.32@tcp:101:rm.0 Request processed in 664us (953us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.073803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9580 00000100:00100000:2.0:1769074928.092227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.092356:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147072 00000100:00100000:0.0:1769074928.092380:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147072 00000100:00100000:0.0:1769074928.092457:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9581 00000100:00100000:0.0:1769074928.092469:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67603:x1855007616147072:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.092501:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.092580:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb19f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b16a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.092675:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.092692:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092706:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092735:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.092742:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092748:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092813:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092821:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092828:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092834:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.092838:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092851:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092865:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.092869:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.092873:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092880:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092894:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092900:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092905:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092910:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.092912:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092919:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092925:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff916052af8500) 00010000:00010000:0.0:1769074928.092928:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.092930:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092935:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.092974:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb19f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b16a expref: 406 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.092985:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.092987:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.092992:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb19f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b16a expref: 406 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.093002:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:0.0:1769074928.093076:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67603:x1855007616147072:12345-192.168.204.32@tcp:101:cp.0 Request processed in 608us (864us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.093084:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9581 00000100:00100000:3.0:1769074928.097010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.097143:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147200 00000100:00100000:1.0:1769074928.097157:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147200 00000100:00100000:1.0:1769074928.097235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9582 00000100:00100000:1.0:1769074928.097247:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67603:x1855007616147200:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.097287:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.097313:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98feb1b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b171 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.097412:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.097430:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097442:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097458:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.097465:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097472:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097593:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097606:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097612:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097618:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.097622:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097631:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097644:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.097648:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.097654:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097659:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb1bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097674:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097680:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097685:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097690:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.097693:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097703:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097710:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff91604e2b2600) 00010000:00010000:1.0:1769074928.097712:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.097714:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097719:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98feb1c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.097757:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98feb1b4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b171 expref: 406 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.097768:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.097771:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.097775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98feb1b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b171 expref: 406 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.097785:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48de00, rc 0) 00000100:00100000:1.0:1769074928.097878:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67603:x1855007616147200:12345-192.168.204.32@tcp:101:cp.0 Request processed in 633us (884us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.097891:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9582 00000100:00100000:1.0:1769074928.103823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.103949:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147456 00000100:00100000:0.0:1769074928.103964:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147456 00000100:00100000:0.0:1769074928.104074:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9583 00000100:00100000:0.0:1769074928.104087:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+405:67603:x1855007616147456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.104131:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.104159:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb1c9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b178 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.104327:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.104347:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.104374:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.104395:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.104403:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.104409:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074928.104872:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc3:0x0], index 1: 0 00010000:00010000:0.0:1769074928.105077:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb1de lrc: 3/1,0 mode: --/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.105088:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb1de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105096:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb1de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105171:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105180:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105187:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105193:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.105199:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105207:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105223:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.105226:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.105232:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105238:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1d0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074928.105254:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b0142ae8 reply state 00000000fb5e31d2 transno 4294969084 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105266:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.105273:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff916052af8500) 00010000:00010000:0.0:1769074928.105275:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074928.105278:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074928.105320:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adb800/0x557988ac98feb1c9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b178 expref: 408 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.105335:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916042d43800/0x557988ac98feb1de lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b178 expref: 407 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.105343:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x18f:0x0].0x0 (ffff916052af8400) 00010000:00010000:0.0:1769074928.105345:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074928.105348:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916042d43800, rc 0) 00000100:00100000:0.0:1769074928.105447:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67603:x1855007616147456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1362us (1964us total) trans 4294969084 rc 0/0 00000100:00100000:0.0:1769074928.105456:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9583 00000100:00100000:3.0:1769074928.112670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.112743:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147584 00000100:00100000:0.0:1769074928.112764:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147584 00000100:00100000:0.0:1769074928.112912:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2771 00000100:00100000:0.0:1769074928.112926:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616147584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.112953:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.112983:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b17f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074928.113017:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074928.113042:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.113045:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.113055:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.113076:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.113093:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74e00, rc 0) 00000100:00100000:0.0:1769074928.113200:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616147584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 277us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.113208:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2771 00000100:00100000:3.0:1769074928.117487:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.117697:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147712 00000100:00100000:0.0:1769074928.117724:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147712 00000100:00100000:0.0:1769074928.117783:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2772 00000100:00100000:0.0:1769074928.117793:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67603:x1855007616147712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.117813:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.117835:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b186 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.117877:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.117886:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.117888:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.117892:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b186 expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.117928:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.117943:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.117957:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626632192:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074928.118056:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617b5bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074928.128968:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626632192:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074928.129007:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b186 expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.129027:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adb800, rc 0) 00000100:00100000:0.0:1769074928.129087:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67603:x1855007616147712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11295us (11609us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.129097:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2772 00000100:00100000:3.0:1769074928.137040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.138181:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616147840 00000100:00100000:0.0:1769074928.138196:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616147840 00010000:00010000:0.0:1769074928.138254:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.138309:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1913 00000100:00100000:0.0:1769074928.138318:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616147840:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074928.138333:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074928.138355:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.138369:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.138392:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98feb1ec lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b17f expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.138409:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.138411:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.138419:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b186 expref: 181 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.138430:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b186 expref: 181 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.138467:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052adb800/0x557988ac98feb1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b186 expref: 181 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074928.138480:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043583480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626632320:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074928.138819:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617b5bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1769074928.146457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.147231:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148096 00000100:00100000:2.0:1769074928.147242:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148096 00000100:00100000:2.0:1769074928.147315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1898 00000100:00100000:2.0:1769074928.147323:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67603:x1855007616148096:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074928.147623:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67603:x1855007616148096:12345-192.168.204.32@tcp:35:cp.0 Request processed in 300us (1175us total) trans 4294969085 rc 0/0 00000100:00100000:2.0:1769074928.147630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1898 00000100:00100000:0.0:1769074928.148642:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043583480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626632320:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074928.148669:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074928.148725:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616147840:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10408us (11695us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.148733:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1913 00000100:00100000:2.0:1769074928.189704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.189829:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148224 00000100:00100000:0.0:1769074928.189840:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148224 00000100:00100000:0.0:1769074928.189901:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9584 00000100:00100000:0.0:1769074928.189912:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67607:x1855007616148224:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074928.189933:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.189956:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b18d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.190027:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.190041:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190052:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190068:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.190075:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190081:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190146:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190154:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190159:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190165:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.190170:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190177:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190189:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.190192:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.190197:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190203:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb201 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190217:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190223:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190228:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190233:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.190237:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190242:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190249:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604f3d4c00) 00010000:00010000:0.0:1769074928.190251:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.190254:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190259:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb208 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.190291:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1fa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b18d expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.190301:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.190303:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.190306:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb1fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b18d expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.190315:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:0.0:1769074928.190379:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67607:x1855007616148224:12345-192.168.204.32@tcp:101:bash.0 Request processed in 469us (684us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.190387:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9584 00000100:00100000:3.0:1769074928.202023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.202159:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148352 00000100:00100000:1.0:1769074928.202170:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148352 00000100:00100000:1.0:1769074928.202235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9585 00000100:00100000:1.0:1769074928.202244:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67608:x1855007616148352:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074928.202276:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.202298:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb20f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b194 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.202368:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.202382:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202392:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202405:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.202411:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202418:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202469:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202476:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202482:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202488:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.202492:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202504:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202515:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.202518:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.202524:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202562:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb216 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202577:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202582:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202588:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202593:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.202595:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202600:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202607:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604e2b2600) 00010000:00010000:1.0:1769074928.202609:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.202611:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202617:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb21d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.202651:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb20f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b194 expref: 410 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.202662:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.202664:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.202667:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb20f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b194 expref: 410 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.202677:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ca00, rc 0) 00000100:00100000:1.0:1769074928.202742:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67608:x1855007616148352:12345-192.168.204.32@tcp:101:rm.0 Request processed in 498us (730us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.202749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9585 00000100:00100000:2.0:1769074928.203943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.204009:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148480 00000100:00100000:1.0:1769074928.204015:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148480 00000100:00100000:1.0:1769074928.204066:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:1.0:1769074928.204074:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2419:x1855007616148480:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074928.204133:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.204151:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb224 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b19b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.204198:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074928.204212:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204224:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204243:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074928.204249:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204256:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204298:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204305:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204312:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204317:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.204321:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204329:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204340:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.204342:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.204346:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204352:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb22b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204363:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204371:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204376:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204381:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.204384:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204390:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204396:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e2b2700) 00010000:00010000:1.0:1769074928.204398:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.204400:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204405:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb232 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.204429:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb224 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b19b expref: 410 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.204438:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.204441:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074928.204444:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb224 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b19b expref: 410 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.204453:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc -2) 00000100:00100000:1.0:1769074928.204516:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2419:x1855007616148480:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 442us (579us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074928.204525:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:2.0:1769074928.208281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.208376:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148608 00000100:00100000:0.0:1769074928.208387:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148608 00000100:00100000:0.0:1769074928.208449:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9586 00000100:00100000:0.0:1769074928.208459:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67608:x1855007616148608:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.208483:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.208503:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb239 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b1d3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.208614:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.208628:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208639:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208655:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.208662:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208668:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208719:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208726:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208732:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208737:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.208741:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208762:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208774:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.208776:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.208781:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208786:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb240 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208799:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208805:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208810:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208815:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.208818:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208823:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208830:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604f3d4c00) 00010000:00010000:0.0:1769074928.208832:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.208835:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208840:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb247 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.208872:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb239 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b1d3 expref: 410 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.208881:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.208884:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.208887:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb239 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b1d3 expref: 410 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.208897:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc 0) 00000100:00100000:0.0:1769074928.208945:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67608:x1855007616148608:12345-192.168.204.32@tcp:101:rm.0 Request processed in 487us (683us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.208952:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9586 00000100:00100000:3.0:1769074928.235507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.237601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.237731:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148864 00000100:00100000:1.0:1769074928.237743:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148864 00000100:00100000:1.0:1769074928.237819:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9587 00000100:00100000:1.0:1769074928.237828:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67611:x1855007616148864:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.237848:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.237870:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb24e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b212 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.237941:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.237958:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.237970:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.237987:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.237994:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238001:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238053:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238061:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238068:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238074:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.238077:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238085:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238109:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.238112:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.238117:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238123:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb255 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238137:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238143:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238148:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238153:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.238155:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238160:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604e2b2700) 00010000:00010000:1.0:1769074928.238172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.238175:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb25c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.238213:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb24e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b212 expref: 410 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.238222:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.238225:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.238228:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb24e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b212 expref: 410 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.238238:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074928.238309:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67611:x1855007616148864:12345-192.168.204.32@tcp:101:cp.0 Request processed in 481us (714us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.238317:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9587 00000100:00100000:0.0:1769074928.241427:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148736 00000100:00100000:0.0:1769074928.241443:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148736 00000100:00100000:1.0:1769074928.241688:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:1.0:1769074928.241698:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2418:x1855007616148736:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074928.241757:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.241777:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb263 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b1da expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.241833:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074928.241853:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241864:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241878:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074928.241884:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241889:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241946:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241952:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241958:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241964:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.241968:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241975:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241986:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.241989:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.241993:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.241999:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb26a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242013:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242019:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242025:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242030:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.242033:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242038:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242044:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e2b2600) 00010000:00010000:1.0:1769074928.242046:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.242049:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242054:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98feb271 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.242080:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb263 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b1da expref: 410 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.242089:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.242092:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074928.242096:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ca00/0x557988ac98feb263 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b1da expref: 410 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.242122:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ca00, rc -2) 00000100:00100000:1.0:1769074928.242186:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2418:x1855007616148736:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 489us (6689us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074928.242194:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:2.0:1769074928.244915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.245043:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616148992 00000100:00100000:0.0:1769074928.245053:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616148992 00000100:00100000:0.0:1769074928.245115:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9588 00000100:00100000:0.0:1769074928.245123:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67611:x1855007616148992:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.245140:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.245160:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb278 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b219 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.245225:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.245241:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245252:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245280:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.245287:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245294:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245339:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245345:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245352:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245357:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.245361:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245369:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245380:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.245383:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.245387:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245393:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb27f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245406:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245412:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245418:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245423:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.245425:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245431:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245437:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604f3d4c00) 00010000:00010000:0.0:1769074928.245440:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.245443:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245448:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb286 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.245476:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb278 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b219 expref: 410 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.245484:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.245487:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.245490:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb278 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b219 expref: 410 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.245498:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74e00, rc 0) 00000100:00100000:0.0:1769074928.246384:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67611:x1855007616148992:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1254us (1471us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.246395:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9588 00000100:00100000:0.0:1769074928.261960:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.262147:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616149248 00000100:00100000:2.0:1769074928.262159:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616149248 00000100:00100000:2.0:1769074928.262221:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9589 00000100:00100000:2.0:1769074928.262232:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67611:x1855007616149248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074928.262253:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.262283:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb28d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b220 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.262407:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074928.262423:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.262433:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.262448:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074928.262455:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.262461:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074928.262981:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc3:0x0], index 0: 0 00010000:00010000:2.0:1769074928.263149:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280e00/0x557988ac98feb2a2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074928.263159:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280e00/0x557988ac98feb2a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263166:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280e00/0x557988ac98feb2a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263200:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263207:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263213:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263219:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.263223:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263229:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263241:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.263244:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.263249:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263254:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb294 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074928.263266:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000033327628 reply state 00000000396ff89f transno 4294969086 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263276:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074928.263281:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604e63ce00) 00010000:00010000:2.0:1769074928.263284:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074928.263287:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074928.263318:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb28d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b220 expref: 412 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.263331:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280e00/0x557988ac98feb2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b220 expref: 411 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.263339:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x190:0x0].0x0 (ffff91604e63c300) 00010000:00010000:2.0:1769074928.263341:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074928.263344:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280e00, rc 0) 00000100:00100000:2.0:1769074928.263416:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67611:x1855007616149248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1186us (1467us total) trans 4294969086 rc 0/0 00000100:00100000:2.0:1769074928.263424:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9589 00000100:00100000:3.0:1769074928.268142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.268445:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616149376 00000100:00100000:0.0:1769074928.268456:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616149376 00000100:00100000:0.0:1769074928.268520:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2773 00000100:00100000:0.0:1769074928.268567:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2420:x1855007616149376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.268587:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.268608:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b227 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074928.268633:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074928.268651:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.268653:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.268662:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.268678:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.268692:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:0.0:1769074928.268750:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616149376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 222us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.268757:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2773 00000100:00100000:3.0:1769074928.277392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.277522:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616149504 00000100:00100000:1.0:1769074928.277930:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616149504 00000100:00100000:1.0:1769074928.278035:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2774 00000100:00100000:1.0:1769074928.278046:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67611:x1855007616149504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.278066:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.278085:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b22e expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.278147:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.278155:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.278157:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.278161:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b22e expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.278197:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.278212:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:1.0:1769074928.278225:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fa3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626632448:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074928.278344:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47240 going to sleep for 11 seconds 00000100:00100000:1.0:1769074928.284942:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fa3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626632448:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074928.284980:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b22e expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.285002:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ca00, rc 0) 00000100:00100000:1.0:1769074928.285067:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67611:x1855007616149504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7022us (7688us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074928.285077:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2774 00000100:00100000:3.0:1769074928.290431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.290517:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616149632 00000100:00100000:0.0:1769074928.290566:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616149632 00010000:00010000:0.0:1769074928.290622:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.290668:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1914 00000100:00100000:0.0:1769074928.290677:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2420:x1855007616149632:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074928.290693:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074928.290713:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.290728:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.290752:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb2b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b227 expref: 182 pid: 25313 timeout: 2017 lvb_type: 1 00010000:00010000:0.0:1769074928.290948:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.290951:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.290960:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b22e expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.290970:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b22e expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.291005:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48ca00/0x557988ac98feb2b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b22e expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074928.291019:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626632576:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074928.291167:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617b5bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1769074928.300227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.302727:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616149888 00000100:00100000:2.0:1769074928.302744:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616149888 00000100:00100000:2.0:1769074928.302828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1899 00000100:00100000:2.0:1769074928.302839:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67611:x1855007616149888:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074928.303250:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67611:x1855007616149888:12345-192.168.204.32@tcp:35:cp.0 Request processed in 412us (3031us total) trans 4294969087 rc 0/0 00000100:00100000:2.0:1769074928.303260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1899 00000100:00100000:0.0:1769074928.305024:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626632576:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074928.305051:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074928.305386:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616149632:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 14422us (14677us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.305396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1914 00000100:00100000:2.0:1769074928.340505:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.340832:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150016 00000100:00100000:3.0:1769074928.340843:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150016 00000100:00100000:3.0:1769074928.340895:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:3.0:1769074928.340904:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2420:x1855007616150016:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074928.340958:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074928.340978:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb2be lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b235 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.341032:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.341046:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341056:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341071:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.341078:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341088:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341177:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341184:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341190:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341195:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.341199:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341206:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341218:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.341222:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.341226:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341231:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb2c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341243:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341249:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341254:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341422:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.341426:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341432:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341440:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604f135900) 00010000:00010000:3.0:1769074928.341443:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.341446:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341451:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb2cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.341481:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb2be lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b235 expref: 414 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.341491:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.341493:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074928.341497:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb2be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b235 expref: 414 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.341506:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc -2) 00000100:00100000:3.0:1769074928.341791:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2420:x1855007616150016:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 886us (1303us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074928.341801:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:1.0:1769074928.355142:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.355406:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150144 00000100:00100000:2.0:1769074928.355417:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150144 00000100:00100000:2.0:1769074928.355499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9590 00000100:00100000:2.0:1769074928.355511:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67618:x1855007616150144:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074928.355574:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.355600:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb2d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b26d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.355691:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.355707:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355719:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355734:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.355741:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355747:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355806:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355813:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355819:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355824:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.355829:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355837:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355853:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.355857:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.355862:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355869:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb2da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355882:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355888:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355893:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355899:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.355901:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355907:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355914:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604e63c500) 00010000:00010000:2.0:1769074928.355917:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.355919:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355924:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb2e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.355954:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb2d3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b26d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.355965:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.355967:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.355971:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb2d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b26d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.355982:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280a00, rc 0) 00000100:00100000:2.0:1769074928.356242:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67618:x1855007616150144:12345-192.168.204.32@tcp:101:bash.0 Request processed in 731us (1120us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.356250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9590 00000100:00100000:2.0:1769074928.385230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.385373:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150272 00000100:00100000:0.0:1769074928.385386:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150272 00000100:00100000:0.0:1769074928.385506:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9591 00000100:00100000:0.0:1769074928.385517:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67619:x1855007616150272:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.385574:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.385596:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb2e8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b274 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.385677:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.385692:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385704:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385735:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.385742:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385748:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385801:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385809:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385815:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385822:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.385826:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385834:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385846:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.385849:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.385853:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385859:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb2ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385873:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385878:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385884:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385888:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.385891:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385901:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385907:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df200) 00010000:00010000:0.0:1769074928.385910:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.385912:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385917:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb2f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.385947:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb2e8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b274 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.385956:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.385959:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.385962:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb2e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b274 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.385971:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:0.0:1769074928.387438:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67619:x1855007616150272:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1911us (2328us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.387450:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9591 00000100:00100000:3.0:1769074928.388759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.390598:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150400 00000100:00100000:0.0:1769074928.390613:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150400 00000100:00100000:0.0:1769074928.390679:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:0.0:1769074928.390689:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2419:x1855007616150400:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074928.390758:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.390779:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb2fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b27b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.390838:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.390853:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390865:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390880:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.390886:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390893:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390947:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390954:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390960:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390966:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9160449a7400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.390969:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390977:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.390990:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.390993:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.390997:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391003:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb304 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391032:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391037:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391043:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391047:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.391050:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391056:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391062:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604f4df400) 00010000:00010000:0.0:1769074928.391065:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.391067:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391072:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb30b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.391111:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb2fd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b27b expref: 414 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.391121:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.391123:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074928.391134:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb2fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b27b expref: 414 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.391144:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f16da00, rc -2) 00000100:00100000:0.0:1769074928.391213:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2419:x1855007616150400:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 525us (2459us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074928.391220:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:3.0:1769074928.400324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.400481:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150528 00000100:00100000:0.0:1769074928.400493:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150528 00000100:00100000:0.0:1769074928.400612:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9592 00000100:00100000:0.0:1769074928.400622:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67619:x1855007616150528:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.400642:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.400663:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb312 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b2b3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.400747:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.400763:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400774:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400789:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.400800:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400807:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400858:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400865:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400871:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400877:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.400882:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400889:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400901:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.400904:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.400909:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400915:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb319 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400928:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400934:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400940:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400944:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.400947:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400953:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400960:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df400) 00010000:00010000:0.0:1769074928.400962:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.400965:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.400970:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb320 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.401001:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb312 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2b3 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.401010:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.401012:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.401016:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb312 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2b3 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.401024:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15000, rc 0) 00000100:00100000:0.0:1769074928.401085:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67619:x1855007616150528:12345-192.168.204.32@tcp:101:rm.0 Request processed in 464us (771us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.401092:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9592 00000100:00100000:1.0:1769074928.419212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.419642:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150656 00000100:00100000:0.0:1769074928.419653:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150656 00000100:00100000:0.0:1769074928.419713:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9593 00000100:00100000:0.0:1769074928.419723:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67622:x1855007616150656:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.419742:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.419763:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb327 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b2ba expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.419830:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.419847:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419858:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419873:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.419880:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419886:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419935:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419943:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419950:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419957:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.419961:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419968:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419979:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.419983:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.419988:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.419994:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb32e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420007:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420012:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420018:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420021:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.420023:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420027:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420031:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df400) 00010000:00010000:0.0:1769074928.420033:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.420035:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420038:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb335 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.420062:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb327 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2ba expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.420068:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.420070:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.420072:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb327 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2ba expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.420077:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15000, rc 0) 00000100:00100000:0.0:1769074928.420279:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67622:x1855007616150656:12345-192.168.204.32@tcp:101:cp.0 Request processed in 556us (1077us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.420288:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9593 00000100:00100000:3.0:1769074928.426694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.426897:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150784 00000100:00100000:1.0:1769074928.426909:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150784 00000100:00100000:1.0:1769074928.426971:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 220 00000100:00100000:1.0:1769074928.426982:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2417:x1855007616150784:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074928.427042:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.427063:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb33c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b2c1 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074928.428413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.428627:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616150912 00000100:00100000:0.0:1769074928.428634:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616150912 00010000:00010000:1.0:1769074928.428646:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074928.428663:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00000100:00100000:0.0:1769074928.428673:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9594 00010000:00010000:1.0:1769074928.428678:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00000100:00100000:0.0:1769074928.428680:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67622:x1855007616150912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.428692:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074928.428694:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.428699:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.428704:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.428759:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.428983:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.428992:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.428998:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.429003:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429010:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429023:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.429026:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.429031:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429037:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb343 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429054:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429060:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429066:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429071:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.429074:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429080:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429087:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e2b2600) 00010000:00010000:1.0:1769074928.429090:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.429093:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429109:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feb34a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.429142:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb33c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2c1 expref: 415 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.429152:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.429153:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074928.429157:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb33c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2c1 expref: 415 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.429169:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc -2) 00010000:00010000:0.0:1769074928.429206:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb351 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b2f9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074928.429246:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:2417:x1855007616150784:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2266us (2562us total) trans 0 rc -2/-2 00010000:00010000:0.0:1769074928.429252:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00000100:00100000:1.0:1769074928.429255:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 220 00010000:00010000:0.0:1769074928.429272:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429280:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429294:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.429301:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429307:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429331:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429337:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429342:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429346:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.429349:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429354:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429362:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.429365:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.429368:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429373:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb358 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429382:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429388:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429393:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429398:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.429400:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429405:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429412:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df400) 00010000:00010000:0.0:1769074928.429414:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.429416:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429421:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb35f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.429441:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb351 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2f9 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.429449:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.429451:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.429454:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb351 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b2f9 expref: 414 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.429474:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15000, rc 0) 00000100:00100000:0.0:1769074928.429521:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67622:x1855007616150912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 841us (1112us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.429527:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9594 00000100:00100000:3.0:1769074928.439026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.451064:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151168 00000100:00100000:0.0:1769074928.451078:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151168 00000100:00100000:0.0:1769074928.451171:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9595 00000100:00100000:0.0:1769074928.451182:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:67622:x1855007616151168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.451201:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.451223:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb366 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b300 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.451339:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.451354:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.451366:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.451381:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.451389:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.451396:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074928.451944:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc4:0x0], index 1: 0 00010000:00010000:0.0:1769074928.452086:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98feb37b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.452120:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98feb37b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452137:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98feb37b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452170:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452177:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452184:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452190:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.452195:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452203:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452215:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.452219:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.452222:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452228:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb36d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074928.452245:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075dc920f reply state 00000000bb2d37c9 transno 4294969088 ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452266:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.452273:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df400) 00010000:00010000:0.0:1769074928.452275:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074928.452278:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074928.452306:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15000/0x557988ac98feb366 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b300 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.452320:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15800/0x557988ac98feb37b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b300 expref: 415 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.452328:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x191:0x0].0x0 (ffff91604f4df200) 00010000:00010000:0.0:1769074928.452331:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074928.452333:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15800, rc 0) 00000100:00100000:0.0:1769074928.452395:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67622:x1855007616151168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1215us (13379us total) trans 4294969088 rc 0/0 00000100:00100000:0.0:1769074928.452404:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9595 00000100:00100000:3.0:1769074928.456559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.456652:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151296 00000100:00100000:1.0:1769074928.456662:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151296 00000100:00100000:1.0:1769074928.456717:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2775 00000100:00100000:1.0:1769074928.456727:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616151296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.456745:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.456767:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b307 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074928.456790:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074928.456809:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.456812:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.456820:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.456837:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.456850:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d400, rc 0) 00000100:00100000:1.0:1769074928.456908:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2420:x1855007616151296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 182us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074928.456916:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2775 00000100:00100000:1.0:1769074928.460961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.461045:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151424 00000100:00100000:0.0:1769074928.461057:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151424 00000100:00100000:0.0:1769074928.461121:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2776 00000100:00100000:0.0:1769074928.461138:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67622:x1855007616151424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.461156:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.461175:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b30e expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.461210:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.461218:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.461221:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.461225:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b30e expref: 183 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.461269:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.461285:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:0.0:1769074928.461302:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626632704:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074928.461416:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617b5bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074928.465118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.465772:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626632704:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074928.465811:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b30e expref: 183 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.465832:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15000, rc 0) 00000100:00100000:0.0:1769074928.465900:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67622:x1855007616151424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4770us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.465909:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2776 00000100:00100000:2.0:1769074928.470621:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151552 00000100:00100000:2.0:1769074928.470637:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151552 00010000:00010000:2.0:1769074928.470709:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 2017 lvb_type: 1 00000100:00100000:2.0:1769074928.470834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1915 00000100:00100000:2.0:1769074928.470845:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616151552:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074928.470861:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074928.470882:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:2.0:1769074928.470896:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:2.0:1769074928.470921:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f48d400/0x557988ac98feb389 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b307 expref: 183 pid: 24564 timeout: 2017 lvb_type: 1 00010000:00010000:2.0:1769074928.470939:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074928.470941:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074928.470948:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b30e expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.470957:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b30e expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.470997:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052b15000/0x557988ac98feb390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b30e expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074928.471009:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626632832:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074928.471118:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484b40 going to sleep for 11 seconds 00000100:00100000:0.0:1769074928.489439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.489867:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151808 00000100:00100000:3.0:1769074928.489880:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151808 00000100:00100000:3.0:1769074928.489948:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1900 00000100:00100000:3.0:1769074928.489959:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67622:x1855007616151808:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074928.490304:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67622:x1855007616151808:12345-192.168.204.32@tcp:35:cp.0 Request processed in 346us (873us total) trans 4294969089 rc 0/0 00000100:00100000:3.0:1769074928.490312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1900 00000100:00100000:2.0:1769074928.490944:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626632832:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074928.490966:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074928.490994:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616151552:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 20152us (25885us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074928.491003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1915 00000100:00100000:0.0:1769074928.526523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.526706:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616151936 00000100:00100000:1.0:1769074928.526717:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616151936 00000100:00100000:1.0:1769074928.526774:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 221 00000100:00100000:1.0:1769074928.526784:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:2418:x1855007616151936:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074928.526844:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.526866:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb397 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b315 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.526925:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074928.526940:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.526951:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.526980:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074928.526987:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.526994:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527044:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527050:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527058:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527064:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.527067:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527074:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527084:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.527087:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.527103:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527109:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb39e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527134:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527140:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527145:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527149:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.527151:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527156:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527162:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e713400) 00010000:00010000:1.0:1769074928.527165:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.527167:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527172:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074928.527197:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb397 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b315 expref: 418 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.527206:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.527209:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074928.527212:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb397 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b315 expref: 418 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.527220:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc -2) 00000100:00100000:1.0:1769074928.527293:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:2418:x1855007616151936:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 510us (779us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074928.527301:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 221 00000100:00100000:1.0:1769074928.560010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.560167:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152064 00000100:00100000:2.0:1769074928.560178:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152064 00000100:00100000:2.0:1769074928.560246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9596 00000100:00100000:2.0:1769074928.560265:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67629:x1855007616152064:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074928.560287:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.560308:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb3ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b34d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.560377:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.560392:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560414:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560431:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.560439:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560446:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560507:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560515:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560522:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560565:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.560571:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560579:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560596:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.560599:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.560603:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560609:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560623:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560628:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560634:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560639:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.560642:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560648:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560655:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604e63c500) 00010000:00010000:2.0:1769074928.560657:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.560660:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560666:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.560697:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb3ac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b34d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.560720:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.560723:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.560727:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb3ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b34d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.560736:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280a00, rc 0) 00000100:00100000:2.0:1769074928.560803:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67629:x1855007616152064:12345-192.168.204.32@tcp:101:bash.0 Request processed in 547us (803us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.560812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9596 00000100:00100000:3.0:1769074928.584958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.585025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.585141:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152320 00000100:00100000:1.0:1769074928.585151:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152320 00000100:00100000:1.0:1769074928.585210:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 222 00000100:00100000:1.0:1769074928.585220:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:2418:x1855007616152320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074928.585262:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.585282:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb3c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b35b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.585343:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074928.585361:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585371:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585384:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074928.585390:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585396:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585446:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585466:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585474:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585480:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.585484:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585492:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585505:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.585508:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.585514:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585521:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb3c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585564:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585571:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585578:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585583:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.585586:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585593:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585601:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604e713400) 00010000:00010000:1.0:1769074928.585603:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.585606:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585612:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb3cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074928.585639:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb3c1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b35b expref: 418 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.585648:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.585651:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074928.585655:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb3c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b35b expref: 418 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.585664:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc -2) 00000100:00100000:1.0:1769074928.585736:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:2418:x1855007616152320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 517us (710us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074928.585744:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 222 00000100:00100000:0.0:1769074928.586309:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152192 00000100:00100000:0.0:1769074928.586317:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152192 00000100:00100000:0.0:1769074928.586366:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9597 00000100:00100000:0.0:1769074928.586375:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67630:x1855007616152192:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.586388:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.586404:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb3d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b354 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.586460:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.586472:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586481:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586498:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.586505:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586512:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586583:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586590:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586595:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586601:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.586604:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586610:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586618:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.586621:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.586623:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586628:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb3dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586639:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586644:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586648:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586652:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.586655:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586660:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586667:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604f4df800) 00010000:00010000:0.0:1769074928.586669:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.586672:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586677:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb3e4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.586699:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb3d6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b354 expref: 418 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.586717:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.586720:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.586724:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb3d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b354 expref: 418 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.586732:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14400, rc 0) 00000100:00100000:0.0:1769074928.586768:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67630:x1855007616152192:12345-192.168.204.32@tcp:101:rm.0 Request processed in 395us (1819us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.586775:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9597 00000100:00100000:3.0:1769074928.603008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.603494:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152448 00000100:00100000:2.0:1769074928.603505:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152448 00000100:00100000:2.0:1769074928.603601:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9598 00000100:00100000:2.0:1769074928.603612:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67630:x1855007616152448:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074928.603632:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.603654:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b362 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.603721:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.603736:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603746:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603760:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.603769:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603775:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603824:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603831:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603837:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603843:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.603847:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603855:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603867:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.603871:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.603875:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603880:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb3f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603890:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603895:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603901:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603906:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.603909:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603915:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603921:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604e63c500) 00010000:00010000:2.0:1769074928.603923:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.603926:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603931:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb3f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.603959:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3eb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b362 expref: 418 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.603969:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.603971:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.603975:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb3eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b362 expref: 418 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.603985:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280000, rc 0) 00000100:00100000:2.0:1769074928.604053:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67630:x1855007616152448:12345-192.168.204.32@tcp:101:rm.0 Request processed in 443us (1056us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.604061:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9598 00000100:00100000:3.0:1769074928.624937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.625043:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152576 00000100:00100000:0.0:1769074928.625053:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152576 00000100:00100000:0.0:1769074928.625134:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9599 00000100:00100000:0.0:1769074928.625144:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67631:x1855007616152576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.625164:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.625185:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb400 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b369 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.625273:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.625289:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625300:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625315:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.625322:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625328:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625385:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625392:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625410:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625416:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.625420:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625427:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625438:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.625441:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.625446:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625460:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb407 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625472:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625477:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625481:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625486:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.625488:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625493:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625499:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604f4df800) 00010000:00010000:0.0:1769074928.625501:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.625503:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625508:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb40e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.625579:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb400 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b369 expref: 418 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.625589:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.625592:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.625595:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb400 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b369 expref: 418 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.625609:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f16da00, rc 0) 00000100:00100000:0.0:1769074928.625669:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67631:x1855007616152576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 527us (741us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.625676:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9599 00000100:00100000:1.0:1769074928.629260:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.629361:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152704 00000100:00100000:2.0:1769074928.629372:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152704 00000100:00100000:2.0:1769074928.629445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9600 00000100:00100000:2.0:1769074928.629461:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67631:x1855007616152704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074928.629480:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074928.629501:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb415 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b370 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.629610:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.629626:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629638:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629655:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074928.629662:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629669:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629730:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629737:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629743:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629749:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.629754:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629760:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629771:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.629775:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.629780:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629785:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb41c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629801:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629806:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629811:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629816:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074928.629819:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629825:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629831:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604e63c500) 00010000:00010000:2.0:1769074928.629834:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.629837:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629843:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb423 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074928.629875:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb415 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b370 expref: 418 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.629884:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074928.629887:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074928.629890:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb415 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b370 expref: 418 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074928.629898:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280000, rc 0) 00000100:00100000:2.0:1769074928.629965:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67631:x1855007616152704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 505us (716us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074928.629972:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9600 00000100:00100000:3.0:1769074928.636898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.637038:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616152960 00000100:00100000:0.0:1769074928.637049:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616152960 00000100:00100000:0.0:1769074928.637118:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9601 00000100:00100000:0.0:1769074928.637128:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+417:67631:x1855007616152960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.637149:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.637171:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb42a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b377 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.637299:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.637314:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637325:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637341:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.637348:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637354:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074928.637797:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc4:0x0], index 0: 0 00010000:00010000:0.0:1769074928.637935:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb43f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.637947:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb43f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637955:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb43f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637985:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637992:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.637998:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638005:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.638010:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638018:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638030:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.638033:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.638038:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638044:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb431 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074928.638061:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000af8ba2b4 reply state 00000000b1bc30b6 transno 4294969090 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638071:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.638077:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604f4df800) 00010000:00010000:0.0:1769074928.638080:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074928.638083:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074928.638124:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb42a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b377 expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.638139:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9160449a7400/0x557988ac98feb43f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b377 expref: 419 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.638147:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x192:0x0].0x0 (ffff91604f4dfb00) 00010000:00010000:0.0:1769074928.638150:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074928.638153:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9160449a7400, rc 0) 00000100:00100000:0.0:1769074928.638213:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67631:x1855007616152960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1086us (1325us total) trans 4294969090 rc 0/0 00000100:00100000:0.0:1769074928.638222:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9601 00000100:00100000:3.0:1769074928.644158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.644245:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153088 00000100:00100000:0.0:1769074928.644256:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153088 00000100:00100000:0.0:1769074928.644318:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2777 00000100:00100000:0.0:1769074928.644326:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616153088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.644344:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.644365:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b37e expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074928.644394:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074928.644430:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.644433:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.644442:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.644467:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074928.644480:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:0.0:1769074928.644569:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2420:x1855007616153088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 243us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.644576:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2777 00000100:00100000:1.0:1769074928.656207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.656355:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153216 00000100:00100000:3.0:1769074928.656366:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153216 00000100:00100000:3.0:1769074928.656566:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2778 00000100:00100000:3.0:1769074928.656578:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67631:x1855007616153216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074928.656598:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074928.656616:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b385 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.656646:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074928.656654:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074928.656657:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074928.656661:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b385 expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.656695:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074928.656709:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:3.0:1769074928.656723:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626632960:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074928.656826:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161473eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074928.659227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.659502:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626632960:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074928.659575:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b385 expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.659593:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9600, rc 0) 00000100:00100000:3.0:1769074928.659644:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67631:x1855007616153216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3069us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074928.659653:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2778 00000100:00100000:0.0:1769074928.660282:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153344 00000100:00100000:0.0:1769074928.660292:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153344 00010000:00010000:0.0:1769074928.660349:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074928.660382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1916 00000100:00100000:0.0:1769074928.660390:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616153344:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074928.660570:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074928.660593:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.660607:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.660631:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98feb44d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b37e expref: 183 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.660644:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.660646:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.660653:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b385 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.660662:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b385 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.660700:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9600/0x557988ac98feb454 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b385 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074928.660714:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626633088:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074928.660783:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617b5bc840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074928.670079:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626633088:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074928.670116:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074928.670225:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616153344:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9834us (11009us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.670236:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1916 00000100:00100000:1.0:1769074928.684783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.684879:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153600 00000100:00100000:0.0:1769074928.684890:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153600 00000100:00100000:0.0:1769074928.684948:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1901 00000100:00100000:0.0:1769074928.684956:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67631:x1855007616153600:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074928.685775:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67631:x1855007616153600:12345-192.168.204.32@tcp:35:cp.0 Request processed in 816us (999us total) trans 4294969091 rc 0/0 00000100:00100000:0.0:1769074928.685784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1901 00000100:00100000:1.0:1769074928.748407:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.749405:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153728 00000100:00100000:3.0:1769074928.749657:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153728 00000100:00100000:3.0:1769074928.750332:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:3.0:1769074928.750347:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:2418:x1855007616153728:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074928.750407:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074928.750453:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb45b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b38c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.750577:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.750595:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750611:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750628:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.750635:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750642:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750723:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750731:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750737:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750744:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.750749:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750761:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750776:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.750780:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.750785:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750791:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb462 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750808:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750814:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750820:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750825:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.750827:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750833:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750839:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604f135900) 00010000:00010000:3.0:1769074928.750841:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.750843:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750850:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb469 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.750882:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb45b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b38c expref: 422 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.750892:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.750894:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074928.750898:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb45b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b38c expref: 422 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.750906:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc -2) 00000100:00100000:3.0:1769074928.751003:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:2418:x1855007616153728:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 661us (3942us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074928.751012:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:2.0:1769074928.769999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.770691:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153856 00000100:00100000:1.0:1769074928.770712:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153856 00000100:00100000:1.0:1769074928.770807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9602 00000100:00100000:1.0:1769074928.770819:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67634:x1855007616153856:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074928.770847:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.770876:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb470 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b393 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.770970:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.770990:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771003:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771020:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.771027:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771034:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771113:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771121:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771128:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771135:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.771140:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771149:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771164:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.771168:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.771174:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb477 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771198:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771204:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771211:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771216:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.771219:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771225:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771231:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604e713400) 00010000:00010000:1.0:1769074928.771234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.771237:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771242:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb47e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.771280:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb470 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b393 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.771291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.771294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.771297:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb470 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b393 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.771307:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48cc00, rc 0) 00000100:00100000:1.0:1769074928.771411:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67634:x1855007616153856:12345-192.168.204.32@tcp:101:bash.0 Request processed in 593us (1422us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.771428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9602 00000100:00100000:2.0:1769074928.800988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074928.801052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.801290:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616153984 00000100:00100000:0.0:1769074928.801304:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616153984 00000100:00100000:0.0:1769074928.801396:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9603 00000100:00100000:0.0:1769074928.801408:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67635:x1855007616153984:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.801460:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.801489:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb485 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b39a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.801632:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.801651:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801666:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801682:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.801690:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801696:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801771:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801783:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801790:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801797:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.801801:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801809:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801823:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.801826:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.801831:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801837:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb48c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801851:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801856:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801862:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801867:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.801869:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801879:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801885:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604f4df900) 00010000:00010000:0.0:1769074928.801888:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.801890:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801896:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb493 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.801934:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb485 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b39a expref: 422 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.801945:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.801947:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.801951:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb485 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b39a expref: 422 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.801962:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:0.0:1769074928.802045:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67635:x1855007616153984:12345-192.168.204.32@tcp:101:rm.0 Request processed in 639us (1071us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.802054:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9603 00000100:00100000:1.0:1769074928.804991:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154112 00000100:00100000:1.0:1769074928.805015:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154112 00000100:00100000:0.0:1769074928.805286:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 224 00000100:00100000:0.0:1769074928.805301:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:2419:x1855007616154112:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074928.805351:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.805389:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb49a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3a1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.805488:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.805518:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805554:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805574:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074928.805581:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805588:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805662:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805670:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805677:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805684:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.805688:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805696:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805713:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.805717:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.805722:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805729:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805745:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805751:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805757:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805762:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.805765:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805771:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805778:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604f4dfd00) 00010000:00010000:0.0:1769074928.805781:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.805784:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805790:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4a8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074928.805824:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb49a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3a1 expref: 422 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.805836:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.805838:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074928.805842:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb49a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3a1 expref: 422 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.805852:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc -2) 00000100:00100000:0.0:1769074928.805949:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:2419:x1855007616154112:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 651us (4895us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074928.805958:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 224 00000100:00100000:2.0:1769074928.811716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.811820:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154240 00000100:00100000:1.0:1769074928.811830:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154240 00000100:00100000:1.0:1769074928.811891:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9604 00000100:00100000:1.0:1769074928.811900:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67635:x1855007616154240:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074928.811920:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.811940:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3a8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.812005:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.812021:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812031:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812045:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.812051:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812058:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812258:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812266:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812277:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812283:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.812287:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812294:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812306:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.812309:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.812313:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812318:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812332:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812338:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812343:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812347:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.812349:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812355:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812366:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604e713400) 00010000:00010000:1.0:1769074928.812369:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.812371:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812377:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.812406:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4af lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3a8 expref: 422 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.812415:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.812418:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.812421:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3a8 expref: 422 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.812429:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48cc00, rc 0) 00000100:00100000:1.0:1769074928.812728:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67635:x1855007616154240:12345-192.168.204.32@tcp:101:rm.0 Request processed in 828us (1021us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.812737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9604 00010000:00010000:2.0:1769074928.820007:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074928.845002:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.845118:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154368 00000100:00100000:1.0:1769074928.845129:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154368 00000100:00100000:1.0:1769074928.845195:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9605 00000100:00100000:1.0:1769074928.845206:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67636:x1855007616154368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.845227:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.845260:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.845336:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.845352:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845363:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845377:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.845384:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845390:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845443:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845451:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845458:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845463:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.845468:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845475:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845491:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.845494:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.845498:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845504:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb4cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845519:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845524:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845581:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845586:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.845589:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845595:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845603:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604e713400) 00010000:00010000:1.0:1769074928.845605:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.845608:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845613:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb4d2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.845643:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4c4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3af expref: 422 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.845653:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.845655:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.845659:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48cc00/0x557988ac98feb4c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3af expref: 422 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.845667:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48cc00, rc 0) 00000100:00100000:1.0:1769074928.845743:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67636:x1855007616154368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 539us (752us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.845751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9605 00000100:00100000:3.0:1769074928.848752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.853334:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154496 00000100:00100000:0.0:1769074928.853349:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154496 00000100:00100000:0.0:1769074928.853785:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9606 00000100:00100000:0.0:1769074928.853796:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67636:x1855007616154496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.853816:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.853837:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3b6 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.853905:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.853919:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.853929:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.853943:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.853952:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.853958:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854007:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854014:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854020:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854025:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.854029:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854036:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854047:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.854050:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.854055:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854061:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb4e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854074:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854079:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854085:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854101:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.854104:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854117:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854125:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604f4dfd00) 00010000:00010000:0.0:1769074928.854128:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.854131:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854136:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb4e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.854165:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4d9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3b6 expref: 422 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.854174:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.854176:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.854179:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb4d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3b6 expref: 422 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.854188:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc 0) 00000100:00100000:0.0:1769074928.854258:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67636:x1855007616154496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 465us (5515us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.854265:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9606 00000100:00100000:3.0:1769074928.859316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.859383:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154752 00000100:00100000:0.0:1769074928.859394:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154752 00000100:00100000:0.0:1769074928.859777:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9607 00000100:00100000:0.0:1769074928.859789:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+421:67636:x1855007616154752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074928.859813:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.859838:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb4ee lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3bd expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.859965:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.859982:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.859992:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860008:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.860013:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860019:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074928.860356:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc5:0x0], index 1: 0 00010000:00010000:0.0:1769074928.860526:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb503 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.860563:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb503 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860570:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb503 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860603:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860609:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860615:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860621:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.860625:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860631:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860643:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.860647:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.860651:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860657:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb4f5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074928.860670:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e781dd59 reply state 00000000668c339e transno 4294969092 ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860679:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.860685:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604f4df900) 00010000:00010000:0.0:1769074928.860688:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074928.860691:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074928.860718:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb4ee lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3bd expref: 424 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.860731:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14400/0x557988ac98feb503 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3bd expref: 423 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.860737:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x193:0x0].0x0 (ffff91604f3c6a00) 00010000:00010000:0.0:1769074928.860739:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074928.860741:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14400, rc 0) 00000100:00100000:0.0:1769074928.860801:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67636:x1855007616154752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1014us (1496us total) trans 4294969092 rc 0/0 00000100:00100000:0.0:1769074928.860808:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9607 00000100:00100000:2.0:1769074928.880578:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.880900:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616154880 00000100:00100000:3.0:1769074928.880911:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616154880 00000100:00100000:3.0:1769074928.880969:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2779 00000100:00100000:3.0:1769074928.880979:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616154880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074928.880997:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074928.881018:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3c4 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074928.881041:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074928.881059:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074928.881061:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074928.881070:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074928.881102:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074928.881114:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc 0) 00000100:00100000:3.0:1769074928.881175:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616154880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 197us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074928.881182:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2779 00000100:00100000:3.0:1769074928.884072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.884158:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155008 00000100:00100000:1.0:1769074928.884169:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155008 00000100:00100000:1.0:1769074928.884227:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2780 00000100:00100000:1.0:1769074928.884239:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67636:x1855007616155008:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.884256:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.884276:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3cb expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.884308:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.884317:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.884319:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074928.884323:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3cb expref: 184 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.884358:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074928.884371:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:1.0:1769074928.884385:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626633216:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074928.884758:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042e47540 going to sleep for 11 seconds 00000100:00100000:1.0:1769074928.889297:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049d20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626633216:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074928.889334:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3cb expref: 184 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.889354:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48cc00, rc 0) 00000100:00100000:1.0:1769074928.889413:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:67636:x1855007616155008:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5177us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074928.889423:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2780 00000100:00100000:2.0:1769074928.889506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.889625:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155136 00000100:00100000:0.0:1769074928.889633:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155136 00010000:00010000:0.0:1769074928.889681:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074928.889727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1917 00000100:00100000:0.0:1769074928.889736:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2419:x1855007616155136:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074928.889749:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074928.889767:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.889781:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.889804:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb511 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3c4 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074928.889819:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.889821:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074928.889827:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3cb expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.889837:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3cb expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.889869:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48cc00/0x557988ac98feb518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3cb expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074928.889883:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626633344:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074928.889939:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1769074928.900135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.900227:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155392 00000100:00100000:1.0:1769074928.900238:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155392 00000100:00100000:1.0:1769074928.900303:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1902 00000100:00100000:1.0:1769074928.900313:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67636:x1855007616155392:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074928.900643:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67636:x1855007616155392:12345-192.168.204.32@tcp:35:cp.0 Request processed in 330us (518us total) trans 4294969093 rc 0/0 00000100:00100000:1.0:1769074928.900651:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1902 00000100:00100000:0.0:1769074928.905644:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626633344:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074928.905673:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074928.905757:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616155136:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 16021us (16250us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074928.905768:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1917 00000100:00100000:2.0:1769074928.952650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.952882:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155520 00000100:00100000:1.0:1769074928.952893:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155520 00000100:00100000:1.0:1769074928.952952:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9608 00000100:00100000:1.0:1769074928.952963:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67640:x1855007616155520:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074928.952983:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.953004:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb51f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.953074:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.953100:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953112:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953128:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.953135:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953142:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953195:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953202:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953210:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953216:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.953220:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953233:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953244:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.953258:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.953263:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953269:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb526 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953283:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953289:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953295:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953300:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.953303:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953310:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953317:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e713400) 00010000:00010000:1.0:1769074928.953320:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.953322:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953328:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb52d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.953356:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb51f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3d2 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.953366:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.953368:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.953372:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb51f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3d2 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.953382:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d600, rc 0) 00000100:00100000:1.0:1769074928.953440:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67640:x1855007616155520:12345-192.168.204.32@tcp:101:bash.0 Request processed in 478us (798us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.953447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9608 00000100:00100000:3.0:1769074928.966462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074928.966748:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155648 00000100:00100000:0.0:1769074928.966758:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155648 00000100:00100000:0.0:1769074928.966818:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9609 00000100:00100000:0.0:1769074928.966828:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67641:x1855007616155648:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074928.966850:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074928.966871:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb534 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3d9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.966943:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.966958:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.966969:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.966983:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074928.966990:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.966997:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967045:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967052:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967059:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967065:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.967070:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967078:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967106:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.967109:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.967114:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967120:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb53b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967133:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967139:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967145:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967150:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074928.967153:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967159:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967165:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604f3c6b00) 00010000:00010000:0.0:1769074928.967168:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.967170:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967176:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb542 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074928.967204:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb534 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3d9 expref: 426 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.967214:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074928.967216:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074928.967220:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb534 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3d9 expref: 426 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074928.967229:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14e00, rc 0) 00000100:00100000:0.0:1769074928.967299:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67641:x1855007616155648:12345-192.168.204.32@tcp:101:rm.0 Request processed in 472us (846us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074928.967307:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9609 00000100:00100000:2.0:1769074928.971271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074928.971349:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155776 00000100:00100000:3.0:1769074928.971359:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155776 00000100:00100000:3.0:1769074928.971414:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:3.0:1769074928.971424:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:2420:x1855007616155776:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074928.971457:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074928.971476:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb549 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3e0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.971561:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.971576:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971586:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971600:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074928.971607:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971613:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971663:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971670:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971676:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971682:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.971685:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971692:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971716:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.971719:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.971723:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971729:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb550 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971742:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971748:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971755:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971760:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074928.971763:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971768:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971775:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604f135700) 00010000:00010000:3.0:1769074928.971778:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074928.971780:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971787:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb557 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074928.971811:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb549 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3e0 expref: 426 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.971820:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074928.971822:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074928.971825:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb549 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3e0 expref: 426 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074928.971834:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc -2) 00000100:00100000:3.0:1769074928.971900:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:2420:x1855007616155776:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 477us (637us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074928.971909:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:2.0:1769074928.976639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.977114:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616155904 00000100:00100000:1.0:1769074928.977125:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616155904 00000100:00100000:1.0:1769074928.977186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9610 00000100:00100000:1.0:1769074928.977197:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67641:x1855007616155904:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074928.977216:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.977236:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb55e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3e7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.977310:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.977325:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977335:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977356:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.977363:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977369:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977415:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977423:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977431:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977437:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.977441:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977449:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977460:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.977463:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.977467:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977474:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb565 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977485:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977851:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977857:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977862:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.977865:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977871:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977880:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e713400) 00010000:00010000:1.0:1769074928.977882:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.977885:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977891:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feb56c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.977926:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb55e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3e7 expref: 426 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.977937:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.977939:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.977943:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb55e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3e7 expref: 426 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.977954:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d600, rc 0) 00000100:00100000:1.0:1769074928.978103:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67641:x1855007616155904:12345-192.168.204.32@tcp:101:rm.0 Request processed in 906us (1472us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.978112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9610 00000100:00100000:2.0:1769074928.994979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074928.995049:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156032 00000100:00100000:1.0:1769074928.995060:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156032 00000100:00100000:1.0:1769074928.995130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9611 00000100:00100000:1.0:1769074928.995140:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67642:x1855007616156032:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074928.995160:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074928.995180:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb573 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3ee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.995241:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.995266:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995276:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995291:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074928.995298:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995305:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995351:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995358:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995366:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995372:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.995376:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995384:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995396:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.995400:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.995404:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995410:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb57a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995424:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995429:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995433:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995437:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074928.995439:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995444:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995455:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e713e00) 00010000:00010000:1.0:1769074928.995458:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.995460:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995466:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb581 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074928.995505:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb573 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3ee expref: 426 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.995515:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074928.995518:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074928.995521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb573 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3ee expref: 426 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074928.995579:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074928.995640:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67642:x1855007616156032:12345-192.168.204.32@tcp:101:cp.0 Request processed in 501us (669us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074928.995647:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9611 00000100:00100000:2.0:1769074929.000923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.001018:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156160 00000100:00100000:0.0:1769074929.001028:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156160 00000100:00100000:0.0:1769074929.001106:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9612 00000100:00100000:0.0:1769074929.001117:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67642:x1855007616156160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.001137:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.001158:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb588 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3f5 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.001227:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.001241:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001263:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001279:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.001291:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001298:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001346:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001353:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001361:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001367:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.001372:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001380:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001392:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.001395:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.001400:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001406:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb58f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001418:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001424:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001429:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001434:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a48400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.001437:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001442:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001449:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604f3c6b00) 00010000:00010000:0.0:1769074929.001451:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.001454:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001459:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a48400/0x557988ac98feb596 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.001503:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb588 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3f5 expref: 426 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.001514:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.001517:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.001521:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb588 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3f5 expref: 426 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.001569:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74e00, rc 0) 00000100:00100000:0.0:1769074929.001621:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67642:x1855007616156160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 506us (709us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.001629:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9612 00000100:00080000:3.0:1769074929.002104:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074929.006876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.006983:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156416 00000100:00100000:1.0:1769074929.006993:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156416 00000100:00100000:1.0:1769074929.007047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9613 00000100:00100000:1.0:1769074929.007056:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67642:x1855007616156416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.007076:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.007110:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb59d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b3fc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.007227:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.007243:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007265:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007288:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.007295:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007302:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00080000:1.0:1769074929.007635:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc5:0x0], index 0: 0 00010000:00010000:1.0:1769074929.007778:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb5b2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.007787:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007795:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007825:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007831:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007842:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007847:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.007851:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007858:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007870:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.007873:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.007877:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007884:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5a4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:1.0:1769074929.007896:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000afe39a2a reply state 0000000054bada59 transno 4294969094 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007905:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.007911:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e713e00) 00010000:00010000:1.0:1769074929.007914:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074929.007916:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074929.007943:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb59d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3fc expref: 428 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.007958:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d600/0x557988ac98feb5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b3fc expref: 427 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.007970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x194:0x0].0x0 (ffff91604e713400) 00010000:00010000:1.0:1769074929.007973:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074929.007975:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d600, rc 0) 00000100:00100000:1.0:1769074929.008029:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:67642:x1855007616156416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 973us (1163us total) trans 4294969094 rc 0/0 00000100:00100000:1.0:1769074929.008037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9613 00000100:00100000:2.0:1769074929.012510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.012647:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156544 00000100:00100000:1.0:1769074929.012657:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156544 00000100:00100000:1.0:1769074929.012728:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2781 00000100:00100000:1.0:1769074929.012738:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2420:x1855007616156544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.012755:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.012774:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b403 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074929.012796:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074929.012813:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.012815:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.012824:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.012840:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.012854:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c400, rc 0) 00000100:00100000:1.0:1769074929.012904:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2420:x1855007616156544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.012916:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2781 00000100:00080000:3.0:1769074929.013170:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074929.017685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.017837:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156672 00000100:00100000:0.0:1769074929.017847:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156672 00000100:00100000:0.0:1769074929.017912:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2782 00000100:00100000:0.0:1769074929.017923:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67642:x1855007616156672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.017940:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.017956:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b40a expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.017984:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.017993:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.017995:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.017999:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b40a expref: 184 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.018032:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.018045:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 184 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074929.018057:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626633472:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074929.018168:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b600 going to sleep for 11 seconds 00000100:00100000:3.0:1769074929.021647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.021844:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616156800 00000100:00100000:2.0:1769074929.021854:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616156800 00010000:00010000:2.0:1769074929.021907:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 185 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.021951:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1918 00000100:00100000:2.0:1769074929.021961:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2419:x1855007616156800:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.021974:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.021995:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 185 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.022010:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 185 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.022036:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.022038:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.022046:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b40a expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.022057:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b40a expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.022104:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b40a expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.022119:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fb16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626633600:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.022198:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484b40 going to sleep for 11 seconds 00010000:00010000:0.0:1769074929.022868:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c400/0x557988ac98feb5c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b403 expref: 185 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074929.022885:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626633472:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074929.022909:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916174a48400/0x557988ac98feb5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b40a expref: 184 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.022920:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a48400, rc 0) 00000100:00100000:0.0:1769074929.022967:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:67642:x1855007616156672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5047us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.022976:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2782 00000100:00100000:0.0:1769074929.028068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.028226:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fb16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626633600:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074929.028258:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074929.028313:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616156800:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6352us (6823us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.028324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1918 00000100:00100000:3.0:1769074929.029869:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157056 00000100:00100000:3.0:1769074929.029880:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157056 00000100:00100000:3.0:1769074929.029997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1903 00000100:00100000:3.0:1769074929.030008:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:67642:x1855007616157056:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074929.030415:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67642:x1855007616157056:12345-192.168.204.32@tcp:35:cp.0 Request processed in 408us (2355us total) trans 4294969095 rc 0/0 00000100:00100000:3.0:1769074929.030424:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1903 00000100:00100000:0.0:1769074929.066326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.066428:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157184 00000100:00100000:2.0:1769074929.066439:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157184 00000100:00100000:2.0:1769074929.066526:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9614 00000100:00100000:2.0:1769074929.066568:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67645:x1855007616157184:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074929.066589:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.066611:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb5ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b411 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.066684:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074929.066710:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066722:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066737:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074929.066745:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066752:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066799:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066806:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066813:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066818:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.066822:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066828:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066840:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.066843:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.066848:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066853:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb5d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066865:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066871:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066877:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066883:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.066885:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066891:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066897:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e63c500) 00010000:00010000:2.0:1769074929.066900:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.066903:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066909:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb5dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.066941:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb5ce lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b411 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.066952:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.066954:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.066958:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb5ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b411 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.066968:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280000, rc 0) 00000100:00100000:2.0:1769074929.067017:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67645:x1855007616157184:12345-192.168.204.32@tcp:101:bash.0 Request processed in 452us (700us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.067025:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9614 00000100:00080000:3.0:1769074929.067164:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769074929.079122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.079184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.079651:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157440 00000100:00100000:0.0:1769074929.079663:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157440 00000100:00100000:0.0:1769074929.079724:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 226 00000100:00100000:0.0:1769074929.079734:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:2420:x1855007616157440:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074929.079773:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.079793:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb5e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b41f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.079860:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.079875:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.079973:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.079986:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.079992:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.079996:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080038:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080042:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080046:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080050:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b14e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.080053:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080058:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080065:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.080068:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.080071:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080074:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb5ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080093:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080099:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080105:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080110:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ed000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.080113:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080118:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080125:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff91604f3c6b00) 00010000:00010000:0.0:1769074929.080126:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.080129:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080134:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ed000/0x557988ac98feb5f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.080162:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb5e3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b41f expref: 430 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.080172:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.080174:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074929.080178:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb5e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b41f expref: 430 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.080186:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74e00, rc -2) 00000100:00100000:0.0:1769074929.080352:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:2420:x1855007616157440:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 618us (1167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074929.080360:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 226 00000100:00100000:1.0:1769074929.080727:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157312 00000100:00100000:1.0:1769074929.080734:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157312 00000100:00100000:1.0:1769074929.080781:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9615 00000100:00100000:1.0:1769074929.080789:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67646:x1855007616157312:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074929.080801:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.080813:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb5f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b418 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.080856:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.080867:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080875:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080890:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.080898:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080904:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080948:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080955:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080966:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080972:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.080976:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080983:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.080992:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.080995:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.080998:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081004:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb5ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081015:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081021:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081027:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081032:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.081035:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081041:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081052:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e713300) 00010000:00010000:1.0:1769074929.081055:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.081058:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081063:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb606 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.081096:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb5f8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b418 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.081106:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.081108:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.081112:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb5f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b418 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.081121:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074929.081985:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67646:x1855007616157312:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1191us (2866us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.081996:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9615 00000100:00100000:2.0:1769074929.087273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.087419:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157568 00000100:00100000:1.0:1769074929.087429:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157568 00000100:00100000:1.0:1769074929.087640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9616 00000100:00100000:1.0:1769074929.087651:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67646:x1855007616157568:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074929.087670:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.087690:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb60d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b426 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.087770:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.087785:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.087797:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088030:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.088039:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088047:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088107:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088115:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088122:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088128:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.088133:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088140:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088157:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.088161:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.088166:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088172:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb614 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088186:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088192:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088198:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088204:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.088207:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088212:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088219:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e713500) 00010000:00010000:1.0:1769074929.088221:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.088224:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088230:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb61b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.088360:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb60d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b426 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.088371:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.088374:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.088378:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb60d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b426 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.088388:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074929.088508:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67646:x1855007616157568:12345-192.168.204.32@tcp:101:rm.0 Request processed in 859us (1245us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.088517:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9616 00000100:00100000:0.0:1769074929.109161:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.109381:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157696 00000100:00100000:1.0:1769074929.109391:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157696 00000100:00100000:1.0:1769074929.109516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9617 00000100:00100000:1.0:1769074929.109526:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67647:x1855007616157696:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.109580:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.109601:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb622 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b42d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.109673:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.109688:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109711:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109727:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.109739:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109746:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109796:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109815:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109822:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109829:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.109833:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109841:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109854:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.109857:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.109862:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109870:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feb629 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109886:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109892:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109899:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109904:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.109907:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109913:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109919:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e713500) 00010000:00010000:1.0:1769074929.109922:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.109925:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109931:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb630 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.109960:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb622 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b42d expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.109969:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.109972:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.109976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb622 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b42d expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.109985:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074929.110049:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67647:x1855007616157696:12345-192.168.204.32@tcp:101:cp.0 Request processed in 524us (897us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.110057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9617 00000100:00100000:0.0:1769074929.113308:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.113938:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616157824 00000100:00100000:1.0:1769074929.113949:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616157824 00000100:00100000:1.0:1769074929.115909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9618 00000100:00100000:1.0:1769074929.115934:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67647:x1855007616157824:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.115956:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.115977:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb637 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b434 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.116040:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.116055:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116066:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116093:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1769074929.116101:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116108:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116157:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116163:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116169:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116175:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.116179:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116187:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116198:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.116202:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.116207:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116213:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb63e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116228:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116234:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.116240:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.120843:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.120851:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.120863:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.120883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604e713300) 00010000:00010000:1.0:1769074929.120886:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.120893:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.120900:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb645 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1769074929.120965:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb637 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b434 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.120977:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.120980:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.120984:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb637 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b434 expref: 430 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.120995:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074929.121067:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67647:x1855007616157824:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5145us (7768us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.121078:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9618 00000100:00100000:2.0:1769074929.127685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.128434:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158080 00000100:00100000:3.0:1769074929.128446:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158080 00000100:00100000:3.0:1769074929.128507:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9619 00000100:00100000:3.0:1769074929.128517:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+429:67647:x1855007616158080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.128569:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.128593:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb64c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b43b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.128723:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.128737:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.128749:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.128763:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.128771:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.128778:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074929.129045:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc6:0x0], index 1: 0 00010000:00010000:3.0:1769074929.129200:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8c00/0x557988ac98feb661 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.129209:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8c00/0x557988ac98feb661 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129216:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8c00/0x557988ac98feb661 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129260:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129268:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129275:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129282:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.129287:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129295:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129307:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.129311:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.129316:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129322:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb653 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074929.129334:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000061a028c9 reply state 00000000059a78bc transno 4294969096 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129345:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.129352:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604f135700) 00010000:00010000:3.0:1769074929.129355:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074929.129357:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074929.129384:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb64c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b43b expref: 432 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.129399:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8c00/0x557988ac98feb661 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b43b expref: 431 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.129407:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x195:0x0].0x0 (ffff91604f135100) 00010000:00010000:3.0:1769074929.129410:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074929.129412:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8c00, rc 0) 00000100:00100000:3.0:1769074929.130811:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:67647:x1855007616158080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2286us (3127us total) trans 4294969096 rc 0/0 00000100:00100000:3.0:1769074929.130826:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9619 00000100:00100000:0.0:1769074929.139136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.139341:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158208 00000100:00100000:2.0:1769074929.139352:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158208 00000100:00100000:2.0:1769074929.139452:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2783 00000100:00100000:2.0:1769074929.139463:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616158208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.139480:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.139499:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b442 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074929.139525:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074929.139564:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.139566:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.139575:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 184 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.139590:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 184 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.139604:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281e00, rc 0) 00000100:00100000:2.0:1769074929.139838:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2419:x1855007616158208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 374us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.139846:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2783 00000100:00080000:3.0:1769074929.140131:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074929.144740:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.144843:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158336 00000100:00100000:0.0:1769074929.144854:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158336 00000100:00100000:0.0:1769074929.144911:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2784 00000100:00100000:0.0:1769074929.144920:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:67647:x1855007616158336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.144938:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.144956:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b449 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.144985:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.144994:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.144996:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.145000:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b449 expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.145037:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.145051:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074929.145066:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626633728:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074929.145178:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074929.154300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.155145:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158464 00000100:00100000:0.0:1769074929.155158:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158464 00010000:00010000:0.0:1769074929.155215:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:0.0:1769074929.155267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1919 00000100:00100000:0.0:1769074929.155277:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+186:2420:x1855007616158464:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074929.155292:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074929.155311:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074929.155326:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:0.0:1769074929.155351:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.155353:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.155361:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b449 expref: 186 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.155372:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b449 expref: 186 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.155408:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b449 expref: 186 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074929.155421:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626633856:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074929.155514:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b480 going to sleep for 11 seconds 00010000:00010000:2.0:1769074929.161527:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e281e00/0x557988ac98feb66f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b442 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.161577:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626633728:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074929.161609:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d0ed000/0x557988ac98feb676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b449 expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.161624:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ed000, rc 0) 00000100:00100000:0.0:1769074929.161886:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:67647:x1855007616158336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 16964us (17154us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.161896:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2784 00000100:00100000:1.0:1769074929.180985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.181317:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626633856:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074929.181342:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074929.181405:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2420:x1855007616158464:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 26128us (27114us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.181417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1919 00000100:00100000:3.0:1769074929.186891:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158720 00000100:00100000:3.0:1769074929.186908:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158720 00000100:00100000:0.0:1769074929.196132:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1904 00000100:00100000:0.0:1769074929.196149:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:67647:x1855007616158720:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074929.196475:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67647:x1855007616158720:12345-192.168.204.32@tcp:35:cp.0 Request processed in 330us (15498us total) trans 4294969097 rc 0/0 00000100:00100000:0.0:1769074929.196484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1904 00000100:00100000:1.0:1769074929.219808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.221748:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158848 00000100:00100000:0.0:1769074929.221762:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158848 00000100:00100000:1.0:1769074929.225253:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:1.0:1769074929.225269:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:2417:x1855007616158848:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074929.225309:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.225329:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb67d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b450 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.225387:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074929.225403:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225416:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225431:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074929.225438:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225444:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225494:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225501:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225507:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225513:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.225516:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225523:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225551:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.225554:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.225559:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225565:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb684 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225580:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225585:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225589:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225594:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.225597:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225603:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225609:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff91604e713300) 00010000:00010000:1.0:1769074929.225612:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.225615:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225620:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb68b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074929.225646:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb67d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b450 expref: 434 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.225655:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.225657:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074929.225660:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb67d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b450 expref: 434 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.225673:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc -2) 00000100:00100000:1.0:1769074929.225898:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:2417:x1855007616158848:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 632us (6099us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074929.225906:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:2.0:1769074929.232386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.232515:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616158976 00000100:00100000:3.0:1769074929.232526:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616158976 00000100:00100000:3.0:1769074929.232638:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9620 00000100:00100000:3.0:1769074929.232648:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67650:x1855007616158976:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074929.232668:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.232689:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb692 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b457 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.232753:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.232767:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232778:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232793:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.232800:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232807:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232857:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232864:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232871:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232878:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.232883:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232891:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232903:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.232906:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.232911:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232917:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb699 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232929:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232935:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232941:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232946:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.232949:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232955:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232962:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604f135f00) 00010000:00010000:3.0:1769074929.232964:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.232967:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.232973:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6a0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.233015:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb692 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b457 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.233024:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.233027:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.233030:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb692 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b457 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.233039:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:3.0:1769074929.233122:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67650:x1855007616158976:12345-192.168.204.32@tcp:101:bash.0 Request processed in 476us (746us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.233129:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9620 00000100:00100000:1.0:1769074929.247208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.247315:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159104 00000100:00100000:2.0:1769074929.247325:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159104 00000100:00100000:2.0:1769074929.247432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9621 00000100:00100000:2.0:1769074929.247443:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67651:x1855007616159104:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074929.247465:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.247485:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b45e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.247598:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074929.247614:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247625:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247642:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074929.247649:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247655:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247713:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247721:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247726:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247732:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.247736:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247742:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247754:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.247758:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.247762:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247769:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb6ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247781:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247788:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247794:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247799:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.247802:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247807:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247813:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604e63c600) 00010000:00010000:2.0:1769074929.247815:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.247818:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247823:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb6b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.247855:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6a7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b45e expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.247864:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.247866:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.247869:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b45e expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.247878:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074929.247932:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67651:x1855007616159104:12345-192.168.204.32@tcp:101:rm.0 Request processed in 490us (733us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.247938:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9621 00000100:00100000:0.0:1769074929.251736:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.251785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.251957:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159232 00000100:00100000:3.0:1769074929.251967:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159232 00000100:00100000:3.0:1769074929.252024:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 228 00000100:00100000:3.0:1769074929.252034:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:2418:x1855007616159232:12345-192.168.204.32@tcp:63:ll_sa.0 00000100:00100000:2.0:1769074929.252099:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159360 00000100:00100000:2.0:1769074929.252103:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159360 00010000:00010000:3.0:1769074929.252103:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.252123:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb6bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b465 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.252139:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9622 00000100:00100000:2.0:1769074929.252146:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67651:x1855007616159360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074929.252157:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.252166:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb6c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b49d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.252182:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074929.252193:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1769074929.252196:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.252207:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.252221:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074929.252228:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.252235:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.253720:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074929.253760:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253769:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253776:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253783:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.253788:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253797:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253811:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.253814:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.253819:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253826:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb6ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253844:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253850:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253856:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253860:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.253863:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253868:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253874:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f135f00) 00010000:00010000:3.0:1769074929.253876:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.253879:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253884:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb6d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.253921:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb6bc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b465 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.253930:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.253932:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074929.253936:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb6bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b465 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.253950:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc -2) 00000100:00100000:3.0:1769074929.254054:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2418:x1855007616159232:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2019us (2325us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074929.254063:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 228 00010000:00010000:2.0:1769074929.258332:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.258939:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1769074929.258957:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.258968:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259024:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259032:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259038:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259044:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.259048:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259054:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259067:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.259070:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.259075:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259090:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb6d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259105:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259111:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259115:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259120:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.259122:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259127:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259133:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074929.259135:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.259138:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb6df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1769074929.259191:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb6c3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b49d expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.259202:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.259204:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.259207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281e00/0x557988ac98feb6c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b49d expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.259217:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281e00, rc 0) 00000100:00100000:0.0:1769074929.259387:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67651:x1855007616159360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 7239us (7599us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.259397:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9622 00000100:00100000:1.0:1769074929.275278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.275327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.275471:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159616 00000100:00100000:3.0:1769074929.275481:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159616 00000100:00100000:2.0:1769074929.275564:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159488 00000100:00100000:2.0:1769074929.275569:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159488 00000100:00100000:1.0:1769074929.275631:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 229 00000100:00100000:1.0:1769074929.275643:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+434:2419:x1855007616159616:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074929.275696:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.275717:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb6e6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4ab expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.275774:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074929.275789:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275799:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275814:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074929.275820:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275825:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275873:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275880:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275886:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275892:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.275896:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275903:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275914:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.275916:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.275920:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275926:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feb6ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275937:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275943:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275948:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.275953:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.276346:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.276353:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.276361:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604e713300) 00010000:00010000:1.0:1769074929.276364:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.276367:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.276373:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feb6f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074929.276401:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb6e6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ab expref: 435 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.276410:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.276412:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074929.276416:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb6e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ab expref: 435 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.276424:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c200, rc -2) 00000100:00100000:1.0:1769074929.276483:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+434:2419:x1855007616159616:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 843us (1154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074929.276490:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 229 00000100:00100000:2.0:1769074929.278558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9623 00000100:00100000:2.0:1769074929.278581:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67654:x1855007616159488:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.278600:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.278619:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.278681:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074929.278818:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278831:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278849:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1769074929.278862:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278868:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278916:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278923:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278931:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278937:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.278941:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278949:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278961:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.278965:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.278969:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb702 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278989:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.278995:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279002:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279007:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.279010:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279016:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279023:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604e63c600) 00010000:00010000:2.0:1769074929.279025:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.279028:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279034:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb709 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:2.0:1769074929.279066:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6fb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4a4 expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.279076:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.279078:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.279093:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb6fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4a4 expref: 434 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.279102:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074929.279164:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67654:x1855007616159488:12345-192.168.204.32@tcp:101:cp.0 Request processed in 593us (3895us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.279172:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9623 00000100:00100000:1.0:1769074929.284033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.284119:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616159744 00000100:00100000:2.0:1769074929.284130:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616159744 00000100:00100000:2.0:1769074929.284191:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9624 00000100:00100000:2.0:1769074929.284201:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67654:x1855007616159744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.284220:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.284240:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb710 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4e3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.284312:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074929.284326:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284337:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284352:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074929.284359:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284365:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284415:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284422:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284428:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284435:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.284439:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284446:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284457:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.284460:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.284464:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284470:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280000/0x557988ac98feb717 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284484:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284490:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284495:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284500:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.284503:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284509:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284515:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604e63c700) 00010000:00010000:2.0:1769074929.284518:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.284521:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284526:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb71e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074929.284601:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb710 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4e3 expref: 434 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.284610:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.284613:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.284616:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb710 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4e3 expref: 434 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.284623:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281400, rc 0) 00000100:00100000:2.0:1769074929.284671:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67654:x1855007616159744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 472us (650us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.284677:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9624 00000100:00100000:1.0:1769074929.288469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.288718:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160000 00000100:00100000:2.0:1769074929.288729:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160000 00000100:00100000:0.0:1769074929.288885:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9625 00000100:00100000:0.0:1769074929.288896:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+433:67654:x1855007616160000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.288918:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.288938:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb725 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4ea expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.289048:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.289062:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289073:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289101:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x82523911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.289109:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289115:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074929.289441:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc6:0x0], index 0: 0 00010000:00010000:0.0:1769074929.289628:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb73a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.289638:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb73a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289644:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb73a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289675:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289682:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289689:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289694:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.289699:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289705:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289717:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.289720:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.289725:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289730:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb72c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074929.289742:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed302269 reply state 0000000075c2987c transno 4294969098 ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289751:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.289757:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074929.289760:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074929.289762:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074929.289790:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb725 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ea expref: 436 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.289804:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b14e00/0x557988ac98feb73a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ea expref: 435 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.289811:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x196:0x0].0x0 (ffff91604f3c6100) 00010000:00010000:0.0:1769074929.289813:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074929.289816:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b14e00, rc 0) 00000100:00100000:0.0:1769074929.289881:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:67654:x1855007616160000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 986us (1420us total) trans 4294969098 rc 0/0 00000100:00100000:0.0:1769074929.289890:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9625 00000100:00100000:0.0:1769074929.294023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.294098:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160128 00000100:00100000:2.0:1769074929.294111:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160128 00000100:00100000:2.0:1769074929.294161:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2785 00000100:00100000:2.0:1769074929.294170:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2417:x1855007616160128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.294189:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.294207:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4f1 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074929.294229:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074929.294247:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.294250:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.294258:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 184 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.294274:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 184 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.294286:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281400, rc 0) 00000100:00100000:2.0:1769074929.294439:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2417:x1855007616160128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 268us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.294447:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2785 00000100:00100000:1.0:1769074929.297979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.298732:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160256 00000100:00100000:2.0:1769074929.298743:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160256 00000100:00100000:2.0:1769074929.298797:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2786 00000100:00100000:2.0:1769074929.298806:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:67654:x1855007616160256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.298824:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.298841:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4f8 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.298866:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.298872:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.298873:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.298876:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f8 expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.298901:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.298912:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.298923:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626633984:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074929.299046:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484b40 going to sleep for 11 seconds 00000100:00100000:0.0:1769074929.302914:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626633984:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074929.302949:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f8 expref: 185 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.302969:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280000, rc 0) 00000100:00100000:0.0:1769074929.303067:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:67654:x1855007616160256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4261us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.303076:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2786 00000100:00100000:0.0:1769074929.308865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.311846:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160384 00000100:00100000:2.0:1769074929.311862:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160384 00010000:00010000:2.0:1769074929.311929:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.312053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1920 00000100:00100000:2.0:1769074929.312063:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2420:x1855007616160384:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.312078:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.312113:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.312128:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.312155:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98feb748 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f1 expref: 185 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.312173:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.312175:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.312183:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f8 expref: 184 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.312195:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f8 expref: 184 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.312238:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e280000/0x557988ac98feb74f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4f8 expref: 184 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.312253:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626634112:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.312351:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484a80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074929.316129:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626634112:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074929.316155:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074929.316209:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2420:x1855007616160384:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4147us (7354us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.316219:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1920 00000100:00100000:1.0:1769074929.319971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.320068:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160640 00000100:00100000:0.0:1769074929.320077:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160640 00000100:00100000:0.0:1769074929.320145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1905 00000100:00100000:0.0:1769074929.320154:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:67654:x1855007616160640:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074929.320439:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67654:x1855007616160640:12345-192.168.204.32@tcp:35:cp.0 Request processed in 285us (478us total) trans 4294969099 rc 0/0 00000100:00100000:0.0:1769074929.320446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1905 00000100:00100000:1.0:1769074929.345178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.345276:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160768 00000100:00100000:3.0:1769074929.345286:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160768 00000100:00100000:3.0:1769074929.345345:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 230 00000100:00100000:3.0:1769074929.345356:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2419:x1855007616160768:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074929.345423:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.345444:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb756 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b4ff expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.345502:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074929.345517:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345564:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345581:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074929.345589:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345595:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345645:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345651:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345657:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345663:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.345667:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345675:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.345687:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.346864:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.346876:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346885:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb75d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346900:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346907:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346913:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346919:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.346922:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346929:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346940:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f135f00) 00010000:00010000:3.0:1769074929.346942:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.346945:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346951:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb764 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.346984:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb756 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ff expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.346995:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.346997:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074929.347001:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb756 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b4ff expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.347008:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc -2) 00000100:00100000:3.0:1769074929.347096:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2419:x1855007616160768:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1740us (1927us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074929.347105:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 230 00000100:00100000:2.0:1769074929.359487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.360029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.360068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.360128:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161024 00000100:00100000:3.0:1769074929.360138:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161024 00000100:00100000:2.0:1769074929.360157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.360174:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616160896 00000100:00100000:0.0:1769074929.360178:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616160896 00000100:00100000:0.0:1769074929.360218:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161280 00000100:00100000:0.0:1769074929.360221:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161280 00000100:00100000:3.0:1769074929.360234:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 275 00000100:00100000:3.0:1769074929.360245:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2420:x1855007616161024:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1769074929.360320:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2420:x1855007616161024:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00080000:0.0:1769074929.360325:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074929.360328:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 275 00000100:00100000:1.0:1769074929.363987:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161152 00000100:00100000:1.0:1769074929.364003:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161152 00000100:00100000:1.0:1769074929.364028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3150 00000100:00100000:1.0:1769074929.364043:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2420:x1855007616161280:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074929.364066:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9626 00000100:00100000:0.0:1769074929.364076:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67661:x1855007616160896:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074929.364101:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1769074929.364130:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2420:x1855007616161280:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 94us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.364137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3150 00000100:00080000:1.0:1769074929.364198:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769074929.364232:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3151 00000100:00100000:1.0:1769074929.364238:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2420:x1855007616161152:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074929.364264:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2420:x1855007616161152:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 27us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.364270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3151 00010000:00010000:0.0:1769074929.364692:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb76b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b537 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.364760:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.364775:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364785:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364801:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074929.364808:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364814:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364864:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364871:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364878:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364884:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.364889:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364896:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364912:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.364916:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.364920:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364926:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb772 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364938:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364944:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364950:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364956:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.364959:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364964:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364970:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f3c6500) 00010000:00010000:0.0:1769074929.364973:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.364975:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.364981:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb779 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074929.365008:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb76b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b537 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.365017:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.365020:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.365024:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb76b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b537 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.365032:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074929.365060:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67661:x1855007616160896:12345-192.168.204.32@tcp:101:bash.0 Request processed in 986us (5583us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.365068:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9626 00000100:00100000:1.0:1769074929.379446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.379446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.379629:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161408 00000100:00100000:0.0:1769074929.379640:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161408 00000100:00100000:0.0:1769074929.379701:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9627 00000100:00100000:0.0:1769074929.379711:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67662:x1855007616161408:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074929.379731:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.379752:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb780 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b53e expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.379818:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.379833:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379845:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379859:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.379871:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379877:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379927:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379934:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379941:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379948:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379954:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.379958:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379966:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379978:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.379981:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.379986:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.379992:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb787 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380005:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380012:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380018:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380023:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.380026:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380031:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380038:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f3c6500) 00010000:00010000:0.0:1769074929.380040:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.380043:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380049:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb78e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.380088:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb780 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b53e expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.380099:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.380102:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.380106:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb780 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b53e expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.380115:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfac00, rc 0) 00000100:00100000:0.0:1769074929.380227:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67662:x1855007616161408:12345-192.168.204.32@tcp:101:rm.0 Request processed in 516us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.380236:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9627 00000100:00100000:0.0:1769074929.380265:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161536 00000100:00100000:0.0:1769074929.380269:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161536 00000100:00100000:0.0:1769074929.380298:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:0.0:1769074929.380305:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2420:x1855007616161536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074929.380343:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.380352:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb795 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b545 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.380378:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.380387:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380395:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380407:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.380413:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380420:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380443:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380449:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380456:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380461:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.380464:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380471:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380479:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.380482:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.380486:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380503:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98feb79c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380513:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380519:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.380525:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.381668:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.381673:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.381680:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.381695:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074929.381698:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.381701:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.381706:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7a3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.381740:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb795 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b545 expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.381749:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.381751:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074929.381755:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb795 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b545 expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.381764:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc -2) 00000100:00100000:0.0:1769074929.388309:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2420:x1855007616161536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 7989us (8848us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074929.388325:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:3.0:1769074929.409106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.409159:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161664 00000100:00100000:0.0:1769074929.409169:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161664 00000100:00100000:0.0:1769074929.409226:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9628 00000100:00100000:0.0:1769074929.409234:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67662:x1855007616161664:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074929.409255:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.409277:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7aa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b57d expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.409354:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.409370:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409380:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409396:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.409403:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409409:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409460:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409467:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409473:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409478:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409484:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.409488:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409513:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409525:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.409528:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.409574:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409580:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409590:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409596:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409601:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409606:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.409608:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409614:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409621:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f4dfd00) 00010000:00010000:0.0:1769074929.409623:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.409626:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409631:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7b8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.409660:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7aa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b57d expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.409669:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.409671:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.409675:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7aa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b57d expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.409683:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa200, rc 0) 00000100:00100000:0.0:1769074929.413876:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67662:x1855007616161664:12345-192.168.204.32@tcp:101:rm.0 Request processed in 4628us (4765us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.413889:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9628 00000100:00100000:3.0:1769074929.430819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.430981:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161792 00000100:00100000:0.0:1769074929.430992:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161792 00000100:00100000:0.0:1769074929.431052:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9629 00000100:00100000:0.0:1769074929.431063:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67665:x1855007616161792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.431090:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.431110:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b584 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.431177:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.431191:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431202:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431221:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.431228:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431233:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431296:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431301:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431305:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431309:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431313:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.431315:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431319:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431327:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.431329:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.431332:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431335:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98feb7c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431346:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431349:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431352:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431355:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.431356:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431359:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431362:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f4dfd00) 00010000:00010000:0.0:1769074929.431364:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.431365:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431368:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98feb7cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.431390:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7bf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b584 expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.431397:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.431398:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.431400:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98feb7bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b584 expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.431408:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074929.431459:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67665:x1855007616161792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 398us (651us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.431466:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9629 00000100:00100000:2.0:1769074929.432097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.432354:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616161920 00000100:00100000:0.0:1769074929.432360:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616161920 00000100:00100000:0.0:1769074929.432400:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:0.0:1769074929.432409:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2420:x1855007616161920:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074929.432456:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.432469:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b58b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.432510:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.432521:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432552:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432567:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074929.432573:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432579:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432619:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432625:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432631:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432636:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.432640:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432645:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432655:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.432657:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.432662:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432668:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb7db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432679:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.432685:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434335:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434343:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.434348:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434357:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434370:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074929.434374:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.434378:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434385:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb7e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074929.434433:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7d4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b58b expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.434444:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.434447:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074929.434451:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb7d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b58b expref: 438 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.434461:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc -2) 00000100:00100000:2.0:1769074929.434879:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:2420:x1855007616161920:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2467us (2780us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074929.434890:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:2.0:1769074929.435361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.435422:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162048 00000100:00100000:0.0:1769074929.435432:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162048 00000100:00100000:0.0:1769074929.435673:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9630 00000100:00100000:0.0:1769074929.435684:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67665:x1855007616162048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.435703:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.435720:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb7e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b5c3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.435783:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.435797:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435807:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435822:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.435829:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435835:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435882:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435889:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435895:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435901:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435906:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfaa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.435910:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435921:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435931:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.435934:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.435938:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435944:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feb7f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435954:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435960:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435966:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435970:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.435973:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435978:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435983:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f3c6500) 00010000:00010000:0.0:1769074929.435985:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.435988:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.435993:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98feb7f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.436017:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb7e9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5c3 expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.436026:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.436028:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.436032:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98feb7e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5c3 expref: 438 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.436039:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfac00, rc 0) 00000100:00100000:0.0:1769074929.436096:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67665:x1855007616162048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 415us (736us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.436102:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9630 00000100:00100000:0.0:1769074929.440151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.440239:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162304 00000100:00100000:3.0:1769074929.440249:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162304 00000100:00100000:3.0:1769074929.440312:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9631 00000100:00100000:3.0:1769074929.440321:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+437:67665:x1855007616162304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.440342:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.440362:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb7fe lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b5ca expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.440474:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.440489:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.440511:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.440526:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.440578:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.440585:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:3.0:1769074929.440899:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc7:0x0], index 1: 0 00010000:00010000:3.0:1769074929.441053:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8600/0x557988ac98feb813 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.441064:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8600/0x557988ac98feb813 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441072:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8600/0x557988ac98feb813 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441118:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441125:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441132:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441139:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441146:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.441150:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441158:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441170:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.441174:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.441179:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441190:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb805 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:3.0:1769074929.441203:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ead1a6f1 reply state 00000000c5412aed transno 4294969100 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441214:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.441220:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f135f00) 00010000:00010000:3.0:1769074929.441223:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074929.441225:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074929.441253:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb7fe lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5ca expref: 440 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.441269:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8600/0x557988ac98feb813 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5ca expref: 439 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.441277:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x197:0x0].0x0 (ffff91604ec89d00) 00010000:00010000:3.0:1769074929.441280:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074929.441282:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8600, rc 0) 00000100:00100000:3.0:1769074929.441351:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:67665:x1855007616162304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1031us (1209us total) trans 4294969100 rc 0/0 00000100:00100000:3.0:1769074929.441361:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9631 00000100:00100000:1.0:1769074929.445650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.445730:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162432 00000100:00100000:0.0:1769074929.445741:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162432 00000100:00100000:0.0:1769074929.445795:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2787 00000100:00100000:0.0:1769074929.445805:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+184:2418:x1855007616162432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074929.445833:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.445858:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b5d1 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074929.445882:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074929.445901:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.445903:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074929.445911:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.445934:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 185 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074929.445947:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa200, rc 0) 00000100:00100000:0.0:1769074929.446004:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2418:x1855007616162432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 201us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.446011:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2787 00000100:00100000:1.0:1769074929.449202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.449291:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162560 00000100:00100000:3.0:1769074929.449301:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162560 00000100:00100000:3.0:1769074929.449356:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2788 00000100:00100000:3.0:1769074929.449367:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:67665:x1855007616162560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.449385:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.449403:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b5d8 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.449435:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.449444:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.449446:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.449451:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d8 expref: 186 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.449485:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.449511:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:3.0:1769074929.449526:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626634240:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074929.449657:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ece480 going to sleep for 11 seconds 00000100:00100000:1.0:1769074929.452309:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626634240:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074929.452344:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d8 expref: 186 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.452362:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9e00, rc 0) 00000100:00100000:1.0:1769074929.452425:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+186:67665:x1855007616162560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3059us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.452435:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2788 00000100:00100000:1.0:1769074929.453518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.453667:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162688 00000100:00100000:2.0:1769074929.453676:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162688 00010000:00010000:2.0:1769074929.453738:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.453775:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1921 00000100:00100000:2.0:1769074929.453784:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+186:2420:x1855007616162688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.453798:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.453817:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.453832:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.453856:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfa200/0x557988ac98feb821 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d1 expref: 186 pid: 25313 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.453872:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.453875:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.453882:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d8 expref: 185 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.453894:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d8 expref: 185 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.453931:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9e00/0x557988ac98feb828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5d8 expref: 185 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.453946:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626634368:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.454022:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484180 going to sleep for 11 seconds 00000100:00100000:0.0:1769074929.459610:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626634368:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074929.459642:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074929.459695:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2420:x1855007616162688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5911us (6181us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.459706:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1921 00000100:00100000:0.0:1769074929.460644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.461606:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616162944 00000100:00100000:1.0:1769074929.461617:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616162944 00000100:00100000:1.0:1769074929.461674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1906 00000100:00100000:1.0:1769074929.461685:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:67665:x1855007616162944:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074929.461980:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67665:x1855007616162944:12345-192.168.204.32@tcp:35:cp.0 Request processed in 295us (1339us total) trans 4294969101 rc 0/0 00000100:00100000:1.0:1769074929.461988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1906 00000100:00100000:1.0:1769074929.500155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.500265:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163072 00000100:00100000:2.0:1769074929.500275:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163072 00000100:00100000:2.0:1769074929.500332:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:2.0:1769074929.500342:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:2419:x1855007616163072:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074929.500396:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.500416:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb82f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b5df expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.500473:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074929.500487:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500509:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500525:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074929.500579:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500586:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500637:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500643:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500650:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500660:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.500664:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500671:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.500683:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.500998:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.501005:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501013:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb836 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501027:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501034:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501040:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501046:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.501049:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501055:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501063:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074929.501066:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.501069:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501075:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb83d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.501116:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb82f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5df expref: 442 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.501126:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.501128:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074929.501132:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb82f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b5df expref: 442 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.501140:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc -2) 00000100:00100000:2.0:1769074929.501207:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:2419:x1855007616163072:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 865us (1060us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074929.501215:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:2.0:1769074929.520817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.520904:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163200 00000100:00100000:3.0:1769074929.520914:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163200 00000100:00100000:3.0:1769074929.520975:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9632 00000100:00100000:3.0:1769074929.520985:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67673:x1855007616163200:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074929.521005:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.521025:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb844 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b617 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.521109:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.521126:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521139:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521153:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.521160:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521167:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521218:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521225:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521233:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521239:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.521243:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521252:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521265:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.521269:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.521274:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521281:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb84b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521294:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521300:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521307:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521312:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.521315:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521321:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521328:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604ec89b00) 00010000:00010000:3.0:1769074929.521330:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.521332:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521338:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb852 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.521364:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb844 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b617 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.521374:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.521377:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.521381:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb844 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b617 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.521390:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:3.0:1769074929.521452:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67673:x1855007616163200:12345-192.168.204.32@tcp:101:bash.0 Request processed in 467us (645us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.521459:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9632 00000100:00100000:0.0:1769074929.545275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.545569:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163328 00000100:00100000:3.0:1769074929.545580:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163328 00000100:00100000:3.0:1769074929.545640:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9633 00000100:00100000:3.0:1769074929.545650:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67674:x1855007616163328:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074929.545671:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.545696:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb859 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b61e expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.545769:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.545786:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545797:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545811:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.545818:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545825:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545881:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545889:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545895:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545901:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545907:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.545910:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545917:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545930:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.545934:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.545938:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545944:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb860 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545957:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545963:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545968:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545974:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.545976:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545982:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545988:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604ec89b00) 00010000:00010000:3.0:1769074929.545990:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.545993:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.545998:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb867 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.546028:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb859 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b61e expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.546038:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.546040:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.546044:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb859 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b61e expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.546053:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:3.0:1769074929.546423:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67674:x1855007616163328:12345-192.168.204.32@tcp:101:rm.0 Request processed in 774us (1157us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.546430:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9633 00000100:00100000:1.0:1769074929.547783:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.547910:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163456 00000100:00100000:2.0:1769074929.547917:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163456 00000100:00100000:2.0:1769074929.547970:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 234 00000100:00100000:2.0:1769074929.547979:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:2417:x1855007616163456:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074929.548018:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.548037:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb86e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b625 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.548100:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074929.548211:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548224:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548252:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074929.548259:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548266:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548791:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548800:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548806:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548812:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.548816:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548823:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548835:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.548838:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.548843:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548849:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb875 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548863:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548868:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548874:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548879:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.548881:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548886:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548892:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074929.548894:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.548897:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548901:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb87c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074929.548928:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb86e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b625 expref: 442 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.548936:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.548939:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074929.548943:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb86e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b625 expref: 442 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.548951:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc -2) 00000100:00100000:2.0:1769074929.549574:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:2417:x1855007616163456:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1591us (1793us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074929.549584:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 234 00000100:00100000:2.0:1769074929.558753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.558869:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163584 00000100:00100000:0.0:1769074929.558880:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163584 00000100:00100000:0.0:1769074929.558942:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9634 00000100:00100000:0.0:1769074929.558952:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67674:x1855007616163584:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074929.558972:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.558994:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb883 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b62c expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.559058:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.559073:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559096:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559228:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.559326:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559336:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559388:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559396:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559414:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559422:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559428:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.559523:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559639:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559652:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.559655:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.559661:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559667:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98feb88a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559683:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559689:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559694:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559699:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.559702:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559707:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559712:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604f3c6500) 00010000:00010000:0.0:1769074929.559715:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.559717:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559722:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feb891 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.559754:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb883 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b62c expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.559764:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.559767:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.559772:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feb883 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b62c expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.559780:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074929.559847:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67674:x1855007616163584:12345-192.168.204.32@tcp:101:rm.0 Request processed in 894us (1100us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.559856:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9634 00000100:00100000:0.0:1769074929.576262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.576332:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163712 00000100:00100000:3.0:1769074929.576342:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163712 00000100:00100000:3.0:1769074929.576394:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9635 00000100:00100000:3.0:1769074929.576402:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67675:x1855007616163712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.576425:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.576456:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb898 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b633 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.576516:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.576569:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576581:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576597:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:3.0:1769074929.576603:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576609:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576659:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576666:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576671:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576677:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576684:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.576688:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576696:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576708:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.576711:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.576717:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576722:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb89f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576734:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576740:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576746:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576752:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.576755:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576761:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576768:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604ec89b00) 00010000:00010000:3.0:1769074929.576770:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.576774:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576779:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074929.576804:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb898 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b633 expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.576811:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.576812:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.576814:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb898 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b633 expref: 442 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.576820:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:3.0:1769074929.576873:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67675:x1855007616163712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 472us (623us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.576878:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9635 00000100:00100000:1.0:1769074929.580873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.584155:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616163840 00000100:00100000:2.0:1769074929.584169:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616163840 00000100:00100000:1.0:1769074929.584334:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9636 00000100:00100000:1.0:1769074929.584344:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67675:x1855007616163840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.584364:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.584386:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb8ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b63a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.584459:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.584473:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584484:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584499:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.584506:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584517:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584601:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584608:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584614:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584619:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.584624:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584630:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584641:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.584644:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.584648:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584653:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb8b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584669:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584674:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584679:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584684:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.584696:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584703:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584710:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604e713300) 00010000:00010000:1.0:1769074929.584712:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.584715:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584719:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98feb8bb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.584748:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb8ad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b63a expref: 442 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.584758:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.584760:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.584763:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feb8ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b63a expref: 442 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.584772:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c200, rc 0) 00000100:00100000:1.0:1769074929.584834:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67675:x1855007616163840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 491us (3970us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.584843:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9636 00000100:00100000:3.0:1769074929.587773:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1769074929.587797:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626634496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1769074929.587869:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074929.588054:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626634496 00000100:00100000:1.0:1769074929.588062:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626634496 00000100:00100000:1.0:1769074929.588132:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1769074929.588139:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1855007626634496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1769074929.588166:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2781184 granted 493431744 pending 114688 free 3764432896 avail 3532910592 00000100:00100000:1.0:1769074929.588211:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1855007626634496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.588218:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1769074929.588280:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626634496:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1769074929.588353:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074929.589159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.591191:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164096 00000100:00100000:2.0:1769074929.591205:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164096 00000100:00100000:2.0:1769074929.591280:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9637 00000100:00100000:2.0:1769074929.591290:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+441:67675:x1855007616164096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.591311:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.591331:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb8c2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b641 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.591454:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.591470:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.591481:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.591496:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x277afc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.591508:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.591514:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074929.591876:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc7:0x0], index 0: 0 00010000:00010000:2.0:1769074929.592034:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb8d7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.592044:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb8d7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592050:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb8d7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592106:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592114:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592120:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592126:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592131:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.592134:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592141:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592153:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.592157:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.592161:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592165:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb8c9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074929.592178:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000079b48687 reply state 000000002ecc18d1 transno 4294969102 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592188:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.592194:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604f4f6a00) 00010000:00010000:2.0:1769074929.592196:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074929.592199:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074929.592230:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb8c2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b641 expref: 444 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.592244:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280200/0x557988ac98feb8d7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b641 expref: 443 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.592252:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x198:0x0].0x0 (ffff91604f4f6e00) 00010000:00010000:2.0:1769074929.592254:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074929.592257:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280200, rc 0) 00000100:00100000:2.0:1769074929.592325:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:67675:x1855007616164096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1037us (3170us total) trans 4294969102 rc 0/0 00000100:00100000:2.0:1769074929.592334:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9637 00000001:00080000:0.0:1769074929.600969:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967847 is committed 00000001:00080000:0.0:1769074929.600996:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967844 is committed 00000100:00100000:0.0:1769074929.601871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.602282:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164224 00000100:00100000:3.0:1769074929.602292:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164224 00000100:00100000:3.0:1769074929.602344:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2789 00000100:00100000:3.0:1769074929.602352:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2418:x1855007616164224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.602368:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.602390:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b648 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074929.602413:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074929.602431:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.602443:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.602450:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.602466:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.602480:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:3.0:1769074929.602554:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2418:x1855007616164224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 203us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074929.602561:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2789 00000001:00080000:2.0:1769074929.605009:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967859 is committed 00000001:00080000:2.0:1769074929.605036:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967855 is committed 00000100:00100000:0.0:1769074929.610324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.610422:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164352 00000100:00100000:2.0:1769074929.610442:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164352 00000100:00100000:2.0:1769074929.610498:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2790 00000100:00100000:2.0:1769074929.610507:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67675:x1855007616164352:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.610526:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.610581:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b64f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.610615:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.610624:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.610626:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.610630:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b64f expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.610667:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.610681:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.610706:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626634624:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074929.610795:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074929.613969:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626634624:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074929.614009:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b64f expref: 180 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.614029:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281e00, rc 0) 00000100:00100000:0.0:1769074929.614102:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67675:x1855007616164352:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3594us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074929.614112:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2790 00000100:00100000:0.0:1769074929.614993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.615073:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164480 00000100:00100000:2.0:1769074929.615090:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164480 00010000:00010000:2.0:1769074929.615136:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 2018 lvb_type: 1 00000100:00100000:2.0:1769074929.615170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1922 00000100:00100000:2.0:1769074929.615179:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2420:x1855007616164480:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.615192:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.615211:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.615225:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.615257:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9000/0x557988ac98feb8e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b648 expref: 180 pid: 24564 timeout: 2018 lvb_type: 1 00010000:00010000:2.0:1769074929.615272:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.615274:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.615281:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b64f expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.615292:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b64f expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.615325:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281e00/0x557988ac98feb8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b64f expref: 179 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.615339:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626634752:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.615410:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484840 going to sleep for 11 seconds 00000100:00100000:2.0:1769074929.618145:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626634752:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074929.618172:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074929.618241:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616164480:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3055us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.618253:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1922 00000100:00100000:0.0:1769074929.619752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.627577:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164736 00000100:00100000:2.0:1769074929.627593:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164736 00000100:00100000:3.0:1769074929.628557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1907 00000100:00100000:3.0:1769074929.628577:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:67675:x1855007616164736:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074929.628897:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67675:x1855007616164736:12345-192.168.204.32@tcp:35:cp.0 Request processed in 327us (9149us total) trans 4294969103 rc 0/0 00000100:00100000:3.0:1769074929.628906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1907 00000100:00100000:0.0:1769074929.686875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.686968:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164864 00000100:00100000:3.0:1769074929.686979:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164864 00000100:00100000:3.0:1769074929.687039:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9638 00000100:00100000:3.0:1769074929.687049:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67678:x1855007616164864:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074929.687071:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.687244:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b656 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.687319:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.687334:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687347:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687361:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.687369:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687376:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687431:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687439:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687445:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687450:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.687454:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687462:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687477:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.687480:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.687486:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687491:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb8fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687504:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687510:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687515:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687521:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.687523:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687630:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687640:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052a4f900) 00010000:00010000:3.0:1769074929.687643:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.687646:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687652:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb901 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.687684:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8f3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b656 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.687694:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.687697:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.687700:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb8f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b656 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.687709:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8800, rc 0) 00000100:00100000:3.0:1769074929.687761:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67678:x1855007616164864:12345-192.168.204.32@tcp:101:bash.0 Request processed in 712us (908us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.687769:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9638 00000100:00100000:0.0:1769074929.701751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.702679:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616164992 00000100:00100000:3.0:1769074929.702702:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616164992 00000100:00100000:3.0:1769074929.702768:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9639 00000100:00100000:3.0:1769074929.702778:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67679:x1855007616164992:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074929.702803:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.702823:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb908 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b65d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.703043:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.703059:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703071:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703097:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.703117:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703124:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703174:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703182:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703189:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703196:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.703200:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703209:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703220:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.703223:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.703227:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703396:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98feb90f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703412:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703418:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703426:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703431:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.703435:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703441:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703449:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052a4f900) 00010000:00010000:3.0:1769074929.703452:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.703454:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703461:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98feb916 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.703493:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb908 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b65d expref: 446 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.703502:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.703505:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.703508:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb908 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b65d expref: 446 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.703517:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8800, rc 0) 00000100:00100000:3.0:1769074929.704698:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67679:x1855007616164992:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1908us (2943us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.704709:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9639 00000100:00100000:0.0:1769074929.709354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.709409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.710629:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165248 00000100:00100000:3.0:1769074929.710641:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165248 00000100:00100000:3.0:1769074929.710694:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9640 00000100:00100000:3.0:1769074929.710703:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67679:x1855007616165248:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074929.710722:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.710743:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb91d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b66b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.710811:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.710827:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710837:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710851:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.710869:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710875:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710926:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710934:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710941:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710947:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.710951:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710959:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710971:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.710974:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.710978:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710985:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb924 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.710997:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711003:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711009:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711014:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.711017:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711022:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711029:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff916052a4f500) 00010000:00010000:3.0:1769074929.711031:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.711035:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711040:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb92b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.711068:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb91d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b66b expref: 446 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.711089:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.711092:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.711096:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb91d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b66b expref: 446 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.711113:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc 0) 00000100:00100000:3.0:1769074929.711166:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67679:x1855007616165248:12345-192.168.204.32@tcp:101:rm.0 Request processed in 465us (1757us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.711174:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9640 00000100:00100000:3.0:1769074929.711199:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165120 00000100:00100000:3.0:1769074929.711203:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165120 00000100:00100000:3.0:1769074929.711243:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00100000:3.0:1769074929.711251:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:2418:x1855007616165120:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074929.711271:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.711280:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb932 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b664 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.711305:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074929.711314:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711322:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711334:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074929.711340:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711347:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711369:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711376:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711382:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711388:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.711390:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711396:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711404:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.711406:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.711409:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711415:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb939 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711423:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711430:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711436:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711441:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.711443:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711449:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711455:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff916052a4f300) 00010000:00010000:3.0:1769074929.711458:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.711460:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711466:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb940 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.711483:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb932 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b664 expref: 446 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.711491:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.711493:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074929.711497:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9000/0x557988ac98feb932 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b664 expref: 446 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.711509:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc -2) 00000100:00100000:3.0:1769074929.711570:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:2418:x1855007616165120:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 320us (2224us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074929.711576:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00100000:0.0:1769074929.736726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.737589:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165376 00000100:00100000:2.0:1769074929.737602:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165376 00000100:00100000:2.0:1769074929.737673:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9641 00000100:00100000:2.0:1769074929.737683:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67680:x1855007616165376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.737702:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.737724:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb947 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b672 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.737803:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.737817:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.737827:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.737839:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.737845:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.737850:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738254:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738261:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738266:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738272:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738278:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.738282:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738289:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738302:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.738305:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.738310:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738317:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb94e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738333:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738339:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738344:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738348:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.738351:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738356:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738362:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff91604f4f6f00) 00010000:00010000:2.0:1769074929.738364:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.738366:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738371:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb955 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.738400:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb947 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b672 expref: 446 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.738409:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.738412:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.738415:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb947 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b672 expref: 446 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.738423:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074929.738732:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67680:x1855007616165376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1048us (2013us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.738740:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9641 00000100:00100000:0.0:1769074929.744997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.746179:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165504 00000100:00100000:2.0:1769074929.746192:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165504 00000100:00100000:2.0:1769074929.746921:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9642 00000100:00100000:2.0:1769074929.746936:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67680:x1855007616165504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.746959:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.746984:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb95c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b679 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.747430:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.747446:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.747457:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.747473:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.747480:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.747487:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748056:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748065:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748071:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748087:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748094:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.748098:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748106:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748118:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.748122:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.748126:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748133:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98feb963 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748145:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748151:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748157:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748162:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.748165:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748171:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748177:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff91604f4f6000) 00010000:00010000:2.0:1769074929.748180:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.748182:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748188:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feb96a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.748219:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb95c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b679 expref: 446 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.748229:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.748232:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.748235:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb95c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b679 expref: 446 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.748244:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280a00, rc 0) 00000100:00100000:2.0:1769074929.748334:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67680:x1855007616165504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1402us (3345us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.748344:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9642 00000100:00100000:3.0:1769074929.752818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.752984:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165760 00000100:00100000:2.0:1769074929.752995:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165760 00000100:00100000:2.0:1769074929.753057:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9643 00000100:00100000:2.0:1769074929.753066:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+445:67680:x1855007616165760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.753097:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.753120:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb971 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b680 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.753255:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.753279:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753290:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753305:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.753311:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753317:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074929.753660:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc8:0x0], index 1: 0 00010000:00010000:2.0:1769074929.753816:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feb986 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.753826:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feb986 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753833:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feb986 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753866:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753873:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753879:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753885:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753894:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.753899:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753906:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753919:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.753922:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.753927:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753933:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb978 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074929.753946:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e093739 reply state 000000008ccbe37e transno 4294969104 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753956:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.753961:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff91604f4f6f00) 00010000:00010000:2.0:1769074929.753964:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074929.753967:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074929.753996:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb971 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b680 expref: 448 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.754010:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71fc00/0x557988ac98feb986 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b680 expref: 447 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.754018:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x199:0x0].0x0 (ffff91604f4f6300) 00010000:00010000:2.0:1769074929.754021:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074929.754023:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71fc00, rc 0) 00000100:00100000:2.0:1769074929.754094:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:67680:x1855007616165760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1028us (1285us total) trans 4294969104 rc 0/0 00000100:00100000:2.0:1769074929.754102:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9643 00000100:00100000:0.0:1769074929.762013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.762171:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616165888 00000100:00100000:2.0:1769074929.762179:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616165888 00000100:00100000:2.0:1769074929.762240:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2791 00000100:00100000:2.0:1769074929.762252:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+177:2420:x1855007616165888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074929.762280:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.762302:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b687 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074929.762325:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074929.762343:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.762346:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.762355:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 178 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.762373:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 178 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074929.762388:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074929.766613:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2420:x1855007616165888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4351us (4596us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.766635:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2791 00000100:00100000:0.0:1769074929.774369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.774465:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166016 00000100:00100000:2.0:1769074929.774476:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166016 00000100:00100000:3.0:1769074929.774564:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2792 00000100:00100000:3.0:1769074929.774579:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:67680:x1855007616166016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074929.774597:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.774615:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b68e expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.774642:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.774648:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.774650:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074929.774653:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b68e expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.774679:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074929.774690:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 2019 lvb_type: 1 00000100:00100000:3.0:1769074929.774703:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626634880:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074929.774797:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916149131240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074929.779187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.779385:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626634880:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074929.779422:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b68e expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.779442:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9000, rc 0) 00000100:00100000:1.0:1769074929.779507:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67680:x1855007616166016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4932us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.779517:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2792 00000100:00100000:2.0:1769074929.779518:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166144 00000100:00100000:2.0:1769074929.779526:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166144 00010000:00010000:2.0:1769074929.779661:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074929.779690:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1923 00000100:00100000:2.0:1769074929.779700:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616166144:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.779713:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.779734:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.779748:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.779774:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e281000/0x557988ac98feb994 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b687 expref: 179 pid: 25313 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.779788:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.779790:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.779796:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b68e expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.779806:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b68e expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.779838:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9000/0x557988ac98feb99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b68e expref: 178 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.779857:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626635008:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.779925:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484180 going to sleep for 11 seconds 00000100:00100000:2.0:1769074929.786466:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626635008:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074929.786495:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074929.786574:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2419:x1855007616166144:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6874us (7393us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.786586:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1923 00000100:00100000:0.0:1769074929.788927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.789122:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166400 00000100:00100000:3.0:1769074929.789132:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166400 00000100:00100000:3.0:1769074929.789231:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1908 00000100:00100000:3.0:1769074929.789251:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:67680:x1855007616166400:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074929.789935:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67680:x1855007616166400:12345-192.168.204.32@tcp:35:cp.0 Request processed in 683us (1081us total) trans 4294969105 rc 0/0 00000100:00100000:3.0:1769074929.789946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1908 00000100:00100000:0.0:1769074929.819451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.819675:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166528 00000100:00100000:3.0:1769074929.819687:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166528 00000100:00100000:3.0:1769074929.819803:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9644 00000100:00100000:3.0:1769074929.819813:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67683:x1855007616166528:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074929.819833:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.819864:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9a2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b695 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.819931:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.819945:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.819965:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.819979:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.819986:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.819993:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820044:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820051:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820057:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820062:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.820066:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820084:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820096:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.820100:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.820104:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820110:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820121:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820127:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820132:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820138:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.820140:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820147:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820153:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff916052a4f300) 00010000:00010000:3.0:1769074929.820156:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.820158:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820164:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9b0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.820193:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9a2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b695 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.820202:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.820205:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.820209:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b695 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.820218:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074929.820287:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67683:x1855007616166528:12345-192.168.204.32@tcp:101:bash.0 Request processed in 466us (1326us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.820294:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9644 00000100:00100000:0.0:1769074929.832384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.832716:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166656 00000100:00100000:3.0:1769074929.832728:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166656 00000100:00100000:3.0:1769074929.832793:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9645 00000100:00100000:3.0:1769074929.832803:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67684:x1855007616166656:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074929.832826:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.832847:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9b7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b69c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.832924:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.832939:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.832950:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.832972:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074929.832979:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.832985:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833035:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833042:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833048:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833053:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.833058:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833066:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833086:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.833089:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.833093:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833099:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98feb9be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833112:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833118:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833123:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833127:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.833130:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833135:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833142:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff916052a4f300) 00010000:00010000:3.0:1769074929.833145:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.833148:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833157:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98feb9c5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074929.833185:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9b7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b69c expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.833194:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.833197:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.833201:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98feb9b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b69c expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.833210:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074929.833274:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67684:x1855007616166656:12345-192.168.204.32@tcp:101:rm.0 Request processed in 473us (900us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074929.833282:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9645 00000100:00100000:0.0:1769074929.837234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074929.837595:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166784 00000100:00100000:3.0:1769074929.837606:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166784 00000100:00100000:3.0:1769074929.837666:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 236 00000100:00100000:3.0:1769074929.837675:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:2418:x1855007616166784:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074929.837714:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.837734:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb9cc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6a3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.837789:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074929.837803:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837819:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837834:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074929.837841:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837847:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837914:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837922:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837928:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837935:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.837938:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837945:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837957:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.837961:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.837966:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837970:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feb9d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837981:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837984:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837988:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837990:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.837992:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837995:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.837998:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff916052a4f500) 00010000:00010000:3.0:1769074929.838000:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.838001:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.838004:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feb9da lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074929.838024:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb9cc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6a3 expref: 450 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.838030:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.838032:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074929.838034:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feb9cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6a3 expref: 450 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.838043:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc -2) 00000100:00100000:3.0:1769074929.838108:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:2418:x1855007616166784:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 435us (884us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074929.838116:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 236 00000100:00100000:0.0:1769074929.838512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.839215:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616166912 00000100:00100000:2.0:1769074929.839224:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616166912 00000100:00100000:2.0:1769074929.839269:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9646 00000100:00100000:2.0:1769074929.839277:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67684:x1855007616166912:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074929.839302:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.839318:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb9e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6aa expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.839369:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.839381:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839391:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839404:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.839410:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839416:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839458:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839465:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839470:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839475:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839481:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.839485:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839492:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839503:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.839506:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.839509:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839515:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feb9e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839528:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839829:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839833:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839836:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.839838:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839841:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839847:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f4f6900) 00010000:00010000:2.0:1769074929.839849:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.839851:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839862:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feb9ef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.839886:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb9e1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6aa expref: 450 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.839891:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.839892:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.839895:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98feb9e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6aa expref: 450 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.839900:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074929.839946:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67684:x1855007616166912:12345-192.168.204.32@tcp:101:rm.0 Request processed in 671us (1436us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.839951:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9646 00010000:00010000:1.0:1769074929.847644:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074929.860166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.860300:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167040 00000100:00100000:1.0:1769074929.860310:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167040 00000100:00100000:1.0:1769074929.860463:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9647 00000100:00100000:1.0:1769074929.860475:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67685:x1855007616167040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.860820:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.860843:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb9f6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6b1 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.860911:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.860930:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.860941:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.860957:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.860964:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.860971:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861022:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861030:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861037:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861042:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.861046:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861054:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861066:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.861078:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.861083:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861089:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feb9fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861103:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861108:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861113:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861118:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.861121:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861126:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861133:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f4f9900) 00010000:00010000:1.0:1769074929.861136:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.861138:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861143:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba04 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.861176:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb9f6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6b1 expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.861185:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.861188:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.861191:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feb9f6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6b1 expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.861199:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074929.861272:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67685:x1855007616167040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 800us (1114us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.861280:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9647 00000100:00100000:0.0:1769074929.865448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.865912:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167168 00000100:00100000:1.0:1769074929.865923:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167168 00000100:00100000:1.0:1769074929.866020:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9648 00000100:00100000:1.0:1769074929.866030:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67685:x1855007616167168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.866050:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.866082:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feba0b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6b8 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.866152:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.866167:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866177:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866192:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.866199:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866205:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866268:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866275:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866290:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866296:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.866300:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866306:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866317:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.866320:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.866325:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866331:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866343:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866348:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866353:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866358:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.866361:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866367:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866374:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f4f9500) 00010000:00010000:1.0:1769074929.866376:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.866379:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866384:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.866413:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feba0b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6b8 expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.866423:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.866425:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.866429:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98feba0b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6b8 expref: 450 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.866438:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c400, rc 0) 00000100:00100000:1.0:1769074929.866842:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67685:x1855007616167168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 811us (1402us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.866851:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9648 00000100:00100000:0.0:1769074929.873610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.873684:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167424 00000100:00100000:1.0:1769074929.873695:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167424 00000100:00100000:1.0:1769074929.873755:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9649 00000100:00100000:1.0:1769074929.873765:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+449:67685:x1855007616167424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.873785:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.873803:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feba20 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6bf expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.874124:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.874137:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.874149:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.874164:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.874170:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.874175:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074929.874731:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc8:0x0], index 0: 0 00010000:00010000:1.0:1769074929.875046:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feba35 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.875059:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feba35 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875067:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feba35 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875111:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875122:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875128:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875134:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.875138:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875144:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875157:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.875160:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.875164:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875170:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d400/0x557988ac98feba27 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074929.875183:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000deb77088 reply state 00000000e0e19fa8 transno 4294969106 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875192:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.875198:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f4f9900) 00010000:00010000:1.0:1769074929.875200:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074929.875203:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074929.875238:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98feba20 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6bf expref: 452 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.875258:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d000/0x557988ac98feba35 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6bf expref: 451 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.875265:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19a:0x0].0x0 (ffff91604f4f9300) 00010000:00010000:1.0:1769074929.875267:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074929.875270:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d000, rc 0) 00000100:00100000:1.0:1769074929.875671:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:67685:x1855007616167424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1905us (2068us total) trans 4294969106 rc 0/0 00000100:00100000:1.0:1769074929.875680:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9649 00000100:00100000:0.0:1769074929.883662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.884218:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167552 00000100:00100000:1.0:1769074929.884229:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167552 00000100:00100000:1.0:1769074929.884452:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2793 00000100:00100000:1.0:1769074929.884464:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616167552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.884483:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.884505:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6c6 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074929.884568:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074929.884590:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.884592:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.884600:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.884617:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.884635:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074929.884698:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616167552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 237us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.884705:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2793 00000100:00100000:0.0:1769074929.888118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.888845:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167680 00000100:00100000:1.0:1769074929.888862:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167680 00000100:00100000:1.0:1769074929.888907:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2794 00000100:00100000:1.0:1769074929.888913:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67685:x1855007616167680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074929.888928:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.888942:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6cd expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.888964:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.888970:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.888971:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074929.888974:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6cd expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.889001:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074929.889010:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:1.0:1769074929.889027:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626635136:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074929.889182:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916141503180 going to sleep for 11 seconds 00000100:00100000:1.0:1769074929.892891:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626635136:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074929.892930:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6cd expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.892949:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d400, rc 0) 00000100:00100000:1.0:1769074929.893410:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67685:x1855007616167680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4492us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074929.893421:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2794 00000100:00100000:0.0:1769074929.893937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.894066:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616167808 00000100:00100000:2.0:1769074929.894082:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616167808 00010000:00010000:2.0:1769074929.894131:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074929.894168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1924 00000100:00100000:2.0:1769074929.894177:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616167808:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074929.894190:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074929.894211:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.894224:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.894253:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98feba43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6c6 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074929.894268:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.894269:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074929.894276:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6cd expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.894285:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6cd expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.894323:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48d400/0x557988ac98feba4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6cd expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074929.894343:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626635264:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074929.894419:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043484a80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074929.897736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.897896:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626635264:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074929.897920:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074929.897972:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2420:x1855007616167808:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3796us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074929.897982:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1924 00000100:00100000:0.0:1769074929.898254:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168064 00000100:00100000:0.0:1769074929.898262:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168064 00000100:00100000:0.0:1769074929.898307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1909 00000100:00100000:0.0:1769074929.898315:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:67685:x1855007616168064:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074929.898623:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67685:x1855007616168064:12345-192.168.204.32@tcp:35:cp.0 Request processed in 308us (896us total) trans 4294969107 rc 0/0 00000100:00100000:0.0:1769074929.898630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1909 00000100:00100000:3.0:1769074929.955664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.955782:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168192 00000100:00100000:1.0:1769074929.955793:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168192 00000100:00100000:2.0:1769074929.955948:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9650 00000100:00100000:2.0:1769074929.955961:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67688:x1855007616168192:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074929.955981:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074929.956003:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feba51 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6d4 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.956084:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.956100:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956111:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956127:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074929.956134:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956146:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956209:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956215:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956220:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956226:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956231:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.956235:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956241:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956252:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.956254:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.956259:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956264:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98feba58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956277:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956281:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956287:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956291:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074929.956294:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956298:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956305:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f6900) 00010000:00010000:2.0:1769074929.956308:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.956310:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956315:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98feba5f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074929.956344:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feba51 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6d4 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.956353:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074929.956356:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074929.956359:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98feba51 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6d4 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074929.956368:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280a00, rc 0) 00000100:00100000:2.0:1769074929.956434:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67688:x1855007616168192:12345-192.168.204.32@tcp:101:bash.0 Request processed in 476us (781us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074929.956442:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9650 00000100:00100000:2.0:1769074929.969298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074929.969346:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074929.969487:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168320 00000100:00100000:1.0:1769074929.969500:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168320 00000100:00100000:1.0:1769074929.969583:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9651 00000100:00100000:1.0:1769074929.969593:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67689:x1855007616168320:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074929.969618:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074929.969641:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba66 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6db expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.969711:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.969725:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969735:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969750:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074929.969757:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969763:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969804:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969818:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969823:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969827:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.969829:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969834:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969842:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.969844:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.969856:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969862:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98feba6d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969873:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969879:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969884:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969889:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074929.969892:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969897:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969904:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f9f00) 00010000:00010000:1.0:1769074929.969906:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.969909:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969914:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98feba74 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074929.969955:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba66 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6db expref: 454 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.969965:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074929.969967:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074929.969971:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98feba66 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6db expref: 454 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074929.969979:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074929.970032:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67689:x1855007616168320:12345-192.168.204.32@tcp:101:rm.0 Request processed in 442us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074929.970038:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9651 00000100:00100000:3.0:1769074929.971294:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168448 00000100:00100000:3.0:1769074929.971303:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168448 00000100:00100000:3.0:1769074929.971353:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 237 00000100:00100000:3.0:1769074929.971362:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:2420:x1855007616168448:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074929.971393:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074929.971407:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feba7b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6e2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.971450:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074929.971463:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.971474:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.971486:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074929.972134:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972149:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972200:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972207:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972213:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972218:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.972222:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972229:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972239:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.972243:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.972247:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972253:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98feba82 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972265:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972271:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972277:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972283:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074929.972286:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972292:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972298:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff916052a4f500) 00010000:00010000:3.0:1769074929.972301:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074929.972304:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972309:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98feba89 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074929.972338:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feba7b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6e2 expref: 454 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.972347:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074929.972349:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074929.972353:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98feba7b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6e2 expref: 454 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074929.972361:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc -2) 00000100:00100000:3.0:1769074929.972437:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:2420:x1855007616168448:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1076us (3088us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074929.972445:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 237 00000100:00100000:1.0:1769074929.977801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074929.977911:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168576 00000100:00100000:0.0:1769074929.977922:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168576 00000100:00100000:0.0:1769074929.977994:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9652 00000100:00100000:0.0:1769074929.978004:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67689:x1855007616168576:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074929.978225:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074929.978330:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feba90 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6e9 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.978402:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.978416:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978427:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978442:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074929.978447:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978453:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978505:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978512:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978517:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978522:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.978528:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.979358:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979369:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979383:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.979386:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.979391:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979397:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98feba97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979414:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979420:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979427:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979433:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074929.979436:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979442:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979449:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f3c6500) 00010000:00010000:0.0:1769074929.979451:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.979454:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979459:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98feba9e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074929.979498:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feba90 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6e9 expref: 454 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.979509:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074929.979511:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074929.979515:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98feba90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6e9 expref: 454 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074929.979524:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfaa00, rc 0) 00000100:00100000:0.0:1769074929.979681:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67689:x1855007616168576:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1677us (1889us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074929.979690:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9652 00000100:00100000:0.0:1769074930.012608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.012879:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168704 00000100:00100000:2.0:1769074930.012890:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168704 00000100:00100000:2.0:1769074930.012950:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9653 00000100:00100000:2.0:1769074930.012960:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67690:x1855007616168704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.012979:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.012999:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febaa5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6f0 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.013065:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.013088:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013099:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013114:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.013120:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013125:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013195:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013202:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013212:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013217:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013223:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.013237:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013245:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013256:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.013259:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.013264:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013270:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febaac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013284:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013290:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013296:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013300:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.013303:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013312:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013319:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f6900) 00010000:00010000:2.0:1769074930.013321:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.013323:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013328:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febab3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.013364:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febaa5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6f0 expref: 454 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.013375:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.013377:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.013381:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febaa5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6f0 expref: 454 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.013388:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc 0) 00000100:00100000:2.0:1769074930.013451:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67690:x1855007616168704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 492us (851us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.013459:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9653 00000100:00100000:2.0:1769074930.027421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.027646:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616168832 00000100:00100000:1.0:1769074930.027657:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616168832 00000100:00100000:1.0:1769074930.027724:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9654 00000100:00100000:1.0:1769074930.027734:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67690:x1855007616168832:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.027754:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.027776:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febaba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6f7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.027841:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.027856:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027867:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027880:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.027887:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027893:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027943:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027950:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027957:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027962:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.027967:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027974:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027985:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.027989:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.027993:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.027999:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febac1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028011:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028016:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028021:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028026:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.028028:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028034:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028043:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f9f00) 00010000:00010000:1.0:1769074930.028046:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.028048:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028053:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c200/0x557988ac98febac8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.028092:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febaba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6f7 expref: 454 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.028103:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.028105:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.028108:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febaba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6f7 expref: 454 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.028118:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074930.028190:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67690:x1855007616168832:12345-192.168.204.32@tcp:101:cp.0 Request processed in 457us (778us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074930.028197:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9654 00000100:00100000:3.0:1769074930.038502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.038732:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169088 00000100:00100000:2.0:1769074930.038743:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169088 00000100:00100000:2.0:1769074930.038794:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9655 00000100:00100000:2.0:1769074930.038801:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+453:67690:x1855007616169088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.038820:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.038838:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febacf lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b6fe expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.038931:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.038944:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.038955:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.038969:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x747bf642 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.038975:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.038982:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074930.039507:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc9:0x0], index 1: 0 00010000:00010000:2.0:1769074930.039700:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98febae4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.039711:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98febae4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039718:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98febae4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039751:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039759:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039765:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039771:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039776:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.039780:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039788:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039800:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.039803:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.039808:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039813:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febad6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074930.039827:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000219a6df reply state 00000000ed71ac39 transno 4294969108 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039837:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.039843:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f6900) 00010000:00010000:2.0:1769074930.039845:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074930.039848:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074930.039877:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febacf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6fe expref: 456 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.039890:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280a00/0x557988ac98febae4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b6fe expref: 455 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.039896:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19b:0x0].0x0 (ffff91604f4f6600) 00010000:00010000:2.0:1769074930.039899:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074930.039901:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280a00, rc 0) 00000100:00100000:2.0:1769074930.040030:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:67690:x1855007616169088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1228us (1537us total) trans 4294969108 rc 0/0 00000100:00100000:2.0:1769074930.040038:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9655 00000001:00080000:2.0:1769074930.044270:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294969108 is committed 00010000:00010000:3.0:1769074930.044526:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044567:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044575:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044582:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044588:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044595:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044610:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4471f797 (ffff916052708f00) 00010000:00010000:3.0:1769074930.044612:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044617:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044620:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44c00/0x557988ac98fea280 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4471f797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044650:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044654:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044657:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044660:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044662:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044666:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044670:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2fbff264 (ffff916052708500) 00010000:00010000:3.0:1769074930.044672:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044673:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044676:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44200/0x557988ac98fea344 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2fbff264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044688:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044693:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044697:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044701:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044704:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044709:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044716:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26770847 (ffff91604e24c700) 00010000:00010000:3.0:1769074930.044718:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044721:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044726:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246a00/0x557988ac98fea408 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x26770847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044742:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044748:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044752:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044755:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e247200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044757:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044760:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044764:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5e5f1f72 (ffff91604e24c000) 00010000:00010000:3.0:1769074930.044766:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044767:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044770:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e247200/0x557988ac98fea4cc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5e5f1f72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044779:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044783:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044786:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044792:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044794:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044798:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044801:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe62d025 (ffff91604faeb000) 00010000:00010000:3.0:1769074930.044802:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044804:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044807:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71e400/0x557988ac98fea57b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe62d025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044815:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044818:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044821:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044824:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044825:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044828:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044833:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfc85cdc6 (ffff91604faeb400) 00010000:00010000:3.0:1769074930.044835:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044837:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044840:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fea62a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfc85cdc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074930.044848:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044852:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044854:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044857:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044858:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044861:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044865:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf217f355 (ffff916174963b00) 00010000:00010000:3.0:1769074930.044866:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044867:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044870:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fea6d9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf217f355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.044879:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044882:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044886:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044889:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91615db8ca00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044890:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044893:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044897:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b471171 (ffff91604f135200) 00010000:00010000:3.0:1769074930.044898:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044900:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044902:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fea79d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6b471171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 00010000:00010000:3.0:1769074930.044911:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044914:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044917:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044919:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044921:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044924:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044930:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x81ca1a76 (ffff91604faebf00) 00010000:00010000:3.0:1769074930.044932:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044935:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044940:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fea861 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x81ca1a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.044952:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044959:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044964:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044969:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1d4a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.044972:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044978:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044985:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x16681c55 (ffff91604faebb00) 00010000:00010000:3.0:1769074930.044988:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.044991:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.044997:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1d4a00/0x557988ac98fea910 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x16681c55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045009:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045136:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045145:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045150:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a44800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045152:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045159:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045167:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7d9d51a3 (ffff91604f135c00) 00010000:00010000:3.0:1769074930.045170:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045173:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045179:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a44800/0x557988ac98fea9e9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7d9d51a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045201:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045208:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045213:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045218:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a45200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045220:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045347:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045359:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa6b74ff (ffff91604f135d00) 00010000:00010000:3.0:1769074930.045361:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045364:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045369:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a45200/0x557988ac98feaaad lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa6b74ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045386:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045391:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045397:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045402:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e246c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045405:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045410:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045417:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca9f45c3 (ffff91604e63cd00) 00010000:00010000:3.0:1769074930.045419:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045422:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045427:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e246c00/0x557988ac98feab5c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xca9f45c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045439:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045445:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045449:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045453:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045456:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045460:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045467:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x26fc322 (ffff91604e63c200) 00010000:00010000:3.0:1769074930.045469:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045471:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045476:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98feac20 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x26fc322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045489:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045494:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045500:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045508:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045511:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045517:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045524:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8592b98f (ffff91604e63ca00) 00010000:00010000:3.0:1769074930.045526:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045700:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045708:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98feace4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8592b98f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045724:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045730:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045735:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045739:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e094800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045742:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045748:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045756:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3df06b78 (ffff91604e2b2400) 00010000:00010000:3.0:1769074930.045759:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045762:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045767:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fead93 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3df06b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045782:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045787:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045793:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045797:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045800:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045805:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045810:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8b337c2d (ffff91604f135400) 00010000:00010000:3.0:1769074930.045812:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045815:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045819:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98feae57 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8b337c2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045831:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045837:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045843:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045847:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91617f989800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045850:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045854:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045859:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1076a11c (ffff91604f135500) 00010000:00010000:3.0:1769074930.045861:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045863:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045868:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91617f989800/0x557988ac98feaf1b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1076a11c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045879:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045884:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045890:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045893:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045896:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045900:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045907:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdc48f45 (ffff916174a68a00) 00010000:00010000:3.0:1769074930.045910:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045912:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045917:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98feafca lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdc48f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045929:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045935:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045940:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045945:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.045948:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045953:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045959:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x490495a0 (ffff91604e63cf00) 00010000:00010000:3.0:1769074930.045961:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.045963:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045968:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98feb079 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x490495a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.045981:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045987:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045993:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.045999:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046001:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046006:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046013:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6b9d9257 (ffff91604f15f100) 00010000:00010000:3.0:1769074930.046111:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046114:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046120:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98feb128 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6b9d9257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046135:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046142:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046147:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046151:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046153:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046159:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046166:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xc5c30344 (ffff916052af8500) 00010000:00010000:3.0:1769074930.046168:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046170:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046175:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feb1d7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xc5c30344 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046186:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046192:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046197:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046202:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046204:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046209:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046215:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d4346b3 (ffff91604e63ce00) 00010000:00010000:3.0:1769074930.046217:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046220:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046225:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98feb29b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5d4346b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046320:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046326:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046332:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046337:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046340:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046345:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046356:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x79a2f09c (ffff91604f4df400) 00010000:00010000:3.0:1769074930.046358:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046362:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046366:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feb374 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x79a2f09c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046377:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046382:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046387:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046395:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046397:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046402:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046408:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6f3d17e (ffff91604f4df800) 00010000:00010000:3.0:1769074930.046410:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046413:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046418:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98feb438 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe6f3d17e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046429:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046434:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046438:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046442:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046444:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046449:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046454:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x744dcc3d (ffff91604f4df900) 00010000:00010000:3.0:1769074930.046456:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046458:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046462:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feb4fc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x744dcc3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046474:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046479:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046484:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046488:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046491:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046496:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046502:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f605fc (ffff91604e713e00) 00010000:00010000:3.0:1769074930.046504:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046507:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046512:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98feb5ab lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3f605fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1769074930.046526:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046649:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046656:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046661:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046664:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046669:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046676:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1bd76029 (ffff91604f135700) 00010000:00010000:3.0:1769074930.046679:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046681:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046686:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98feb65a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1bd76029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046702:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046708:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046713:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046717:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046719:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046723:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046730:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82523911 (ffff91604f3c6b00) 00010000:00010000:3.0:1769074930.046732:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046735:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046740:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98feb733 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x82523911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046752:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046759:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046763:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046768:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046771:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046777:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046783:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd6d1880a (ffff91604f135f00) 00010000:00010000:3.0:1769074930.046786:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046788:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046792:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feb80c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd6d1880a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046804:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046810:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046815:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046819:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046821:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046826:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046832:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x277afc75 (ffff91604f4f6a00) 00010000:00010000:3.0:1769074930.046835:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046837:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046842:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98feb8d0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x277afc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046853:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046859:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046865:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046870:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046872:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046884:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046891:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3f810e0 (ffff91604f4f6f00) 00010000:00010000:3.0:1769074930.046893:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046896:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046901:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98feb97f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3f810e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046914:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046919:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046924:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046928:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046931:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046936:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046942:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x95bf9789 (ffff91604f4f9900) 00010000:00010000:3.0:1769074930.046944:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046947:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046951:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98feba2e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x95bf9789 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.046964:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046968:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046973:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046978:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.046980:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046985:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.046991:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x747bf642 (ffff91604f4f6900) 00010000:00010000:3.0:1769074930.046993:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.046996:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074930.047002:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febadd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x747bf642 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000100:00100000:0.0:1769074930.050453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.050995:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169216 00000100:00100000:1.0:1769074930.051007:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169216 00000100:00100000:1.0:1769074930.051188:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2795 00000100:00100000:1.0:1769074930.051198:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+178:2418:x1855007616169216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.051218:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.051249:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b705 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074930.051278:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074930.051300:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.051302:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.051312:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.051328:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 179 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.051341:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074930.051440:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2418:x1855007616169216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 243us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074930.051448:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2795 00000100:00100000:0.0:1769074930.055301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.056099:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169344 00000100:00100000:1.0:1769074930.056112:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169344 00000100:00100000:1.0:1769074930.056231:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2796 00000100:00100000:1.0:1769074930.056241:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:67690:x1855007616169344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.056261:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.056278:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b70c expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.056311:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.056319:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.056322:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.056325:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b70c expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.056359:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.056369:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:1.0:1769074930.056378:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626635392:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074930.056467:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916141503180 going to sleep for 11 seconds 00000100:00100000:3.0:1769074930.062658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.062782:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626635392:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074930.062809:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169472 00000100:00100000:2.0:1769074930.062816:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169472 00010000:00010000:1.0:1769074930.062819:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b70c expref: 180 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.062838:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c200, rc 0) 00010000:00010000:2.0:1769074930.062861:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:1.0:1769074930.062899:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67690:x1855007616169344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6659us (7609us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.062900:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1925 00000100:00100000:1.0:1769074930.062907:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2796 00000100:00100000:2.0:1769074930.062909:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616169472:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074930.062922:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074930.062942:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.062955:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.062983:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98febaf2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b705 expref: 180 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.062996:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.062998:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.063004:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b70c expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.063121:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b70c expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.063156:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48c200/0x557988ac98febaf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b70c expref: 179 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074930.063169:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626635520:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074930.063235:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042cbdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1769074930.068259:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626635520:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074930.068286:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074930.068351:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2420:x1855007616169472:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5442us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.068360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1925 00000100:00100000:0.0:1769074930.070310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.070393:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169728 00000100:00100000:2.0:1769074930.070403:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169728 00000100:00100000:2.0:1769074930.070465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1910 00000100:00100000:2.0:1769074930.070474:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+354:67690:x1855007616169728:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074930.070794:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67690:x1855007616169728:12345-192.168.204.32@tcp:35:cp.0 Request processed in 321us (493us total) trans 4294969109 rc 0/0 00000100:00100000:2.0:1769074930.070802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1910 00000100:00100000:0.0:1769074930.111308:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.111392:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169856 00000100:00100000:3.0:1769074930.111403:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169856 00000100:00100000:3.0:1769074930.111461:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 238 00000100:00100000:3.0:1769074930.111470:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:2420:x1855007616169856:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074930.111510:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.111559:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febb00 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b713 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.111621:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.111637:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111649:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111663:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.111670:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111677:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111726:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111734:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111741:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111747:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.111751:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111758:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.111772:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.111776:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.111780:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112227:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febb07 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112243:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112249:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112254:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112260:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.112263:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112269:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112278:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff916052a4f500) 00010000:00010000:3.0:1769074930.112281:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.112284:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112290:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8200/0x557988ac98febb0e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.112318:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febb00 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b713 expref: 356 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.112328:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.112330:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074930.112334:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febb00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b713 expref: 356 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.112342:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc -2) 00000100:00100000:2.0:1769074930.113703:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:2420:x1855007616169856:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2227us (2398us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074930.113716:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 238 00000100:00100000:3.0:1769074930.137092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.137469:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616169984 00000100:00100000:2.0:1769074930.137480:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616169984 00000100:00100000:1.0:1769074930.137655:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9656 00000100:00100000:1.0:1769074930.137666:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67694:x1855007616169984:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074930.137687:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.137708:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb15 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b71a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.137770:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.137796:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.137808:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.137823:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.137831:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.137837:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138124:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138132:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138138:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138144:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.138148:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138154:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138166:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.138169:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.138174:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138179:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb1c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138190:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138195:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138200:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138205:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48de00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.138207:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138212:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138217:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f4f9400) 00010000:00010000:1.0:1769074930.138219:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.138222:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138227:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.138844:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb15 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b71a expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.139086:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.139090:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.139095:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b71a expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.139106:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074930.139180:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67694:x1855007616169984:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1515us (2096us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074930.139188:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9656 00000100:00100000:0.0:1769074930.154813:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.154907:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170112 00000100:00100000:2.0:1769074930.154917:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170112 00000100:00100000:2.0:1769074930.154990:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9657 00000100:00100000:2.0:1769074930.155000:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67695:x1855007616170112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074930.155021:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.155041:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febb2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b721 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.155129:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.155145:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155155:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155170:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.155177:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155188:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155239:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155245:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155251:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155256:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155261:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.155266:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155272:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155283:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.155286:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.155290:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155295:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febb31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155309:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155316:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155321:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155326:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.155328:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155333:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155339:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f4f6700) 00010000:00010000:2.0:1769074930.155341:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.155344:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155349:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febb38 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.155377:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febb2a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b721 expref: 356 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.155388:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.155390:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.155393:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febb2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b721 expref: 356 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.155401:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc 0) 00000100:00100000:2.0:1769074930.155466:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67695:x1855007616170112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 467us (663us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.155474:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9657 00000100:00100000:0.0:1769074930.158085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.158128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.158236:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170368 00000100:00100000:1.0:1769074930.158246:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170368 00000100:00100000:1.0:1769074930.158307:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9658 00000100:00100000:2.0:1769074930.158315:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170240 00000100:00100000:1.0:1769074930.158316:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67695:x1855007616170368:12345-192.168.204.32@tcp:101:rm.0 00000100:00100000:2.0:1769074930.158319:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170240 00010000:00010000:1.0:1769074930.158335:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1769074930.158355:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 239 00010000:00010000:1.0:1769074930.158357:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb3f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b72f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074930.158361:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+356:2418:x1855007616170240:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074930.158385:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.158394:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febb46 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b728 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.158428:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074930.158429:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074930.158582:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.158596:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.158613:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.158619:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.158625:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.159128:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159139:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159153:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.159160:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159166:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159194:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159201:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159207:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159213:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48de00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.159218:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159305:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159319:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.159322:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.159327:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159332:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159346:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159352:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159358:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159362:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.159366:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159371:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159378:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f4f9400) 00010000:00010000:1.0:1769074930.159381:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.159383:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159483:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb62 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.159587:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb3f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b72f expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.159599:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.159601:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.159605:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb3f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b72f expref: 358 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.159615:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074930.159743:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+357:67695:x1855007616170368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1427us (1611us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074930.159751:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9658 00010000:00010000:2.0:1769074930.168335:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.168352:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.168359:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.168366:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.168371:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.168381:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169100:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.169105:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.169111:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169119:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febb4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169137:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169143:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169150:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169156:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.169159:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169165:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169174:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.169177:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.169181:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169187:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febb5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.169330:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febb46 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b728 expref: 356 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.169341:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.169343:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074930.169347:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febb46 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b728 expref: 356 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.169357:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc -2) 00000100:00100000:2.0:1769074930.169905:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:2418:x1855007616170240:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 11540us (11834us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074930.169915:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 239 00000100:00100000:0.0:1769074930.176977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.177091:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170496 00000100:00100000:1.0:1769074930.177103:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170496 00000100:00100000:1.0:1769074930.177195:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9659 00000100:00100000:1.0:1769074930.177205:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67696:x1855007616170496:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.177238:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.177260:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b736 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.177330:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.177345:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177357:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177372:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.177379:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177384:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177452:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177460:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177466:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177472:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.177476:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177487:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177509:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.177512:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.177517:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177522:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febb70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177578:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177584:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177589:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177594:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48de00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.177597:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177603:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177610:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f4f9400) 00010000:00010000:1.0:1769074930.177613:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.177616:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177621:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febb77 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.177653:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb69 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b736 expref: 356 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.177662:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.177665:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.177668:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febb69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b736 expref: 356 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.177687:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074930.177742:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67696:x1855007616170496:12345-192.168.204.32@tcp:101:cp.0 Request processed in 538us (775us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074930.177750:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9659 00000100:00100000:3.0:1769074930.181669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.181775:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170624 00000100:00100000:1.0:1769074930.181787:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170624 00000100:00100000:1.0:1769074930.181840:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9660 00000100:00100000:1.0:1769074930.181847:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67696:x1855007616170624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.181865:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.181884:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febb7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b73d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.181941:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.181955:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.181966:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.181985:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074930.181990:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.181994:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182042:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182047:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182052:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182056:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.182058:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182063:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182084:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.182086:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.182090:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182094:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febb85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182104:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182108:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182112:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182115:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.182116:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182119:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182123:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f4f9a00) 00010000:00010000:1.0:1769074930.182124:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.182125:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182128:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febb8c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074930.182152:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febb7e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b73d expref: 356 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.182158:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.182160:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.182162:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febb7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b73d expref: 356 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.182169:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074930.182235:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67696:x1855007616170624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 389us (578us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074930.182241:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9660 00000100:00100000:2.0:1769074930.189348:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.189441:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616170880 00000100:00100000:0.0:1769074930.189452:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616170880 00000100:00100000:0.0:1769074930.189510:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9661 00000100:00100000:0.0:1769074930.189522:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+355:67696:x1855007616170880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.189571:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.189590:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febb93 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b744 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.189689:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.189705:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.189716:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.189731:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.189738:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.189744:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074930.190009:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc9:0x0], index 0: 0 00010000:00010000:0.0:1769074930.190157:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98febba8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.190167:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98febba8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190174:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98febba8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190212:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190219:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190225:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190231:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190237:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.190241:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190248:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190259:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.190262:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.190267:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190272:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febb9a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074930.190285:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050bc6ad1 reply state 000000000ed3e286 transno 4294969110 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190296:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.190302:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f3c6500) 00010000:00010000:0.0:1769074930.190304:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074930.190306:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074930.190335:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febb93 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b744 expref: 358 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.190355:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfaa00/0x557988ac98febba8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b744 expref: 357 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.190362:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19c:0x0].0x0 (ffff91604f3c6e00) 00010000:00010000:0.0:1769074930.190364:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074930.190366:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfaa00, rc 0) 00000100:00100000:0.0:1769074930.190569:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+358:67696:x1855007616170880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1049us (1230us total) trans 4294969110 rc 0/0 00000100:00100000:0.0:1769074930.190578:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9661 00000100:00100000:2.0:1769074930.199133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.199331:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171008 00000100:00100000:1.0:1769074930.199342:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171008 00000100:00100000:1.0:1769074930.199432:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2797 00000100:00100000:1.0:1769074930.199443:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616171008:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074930.199461:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.199481:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b74b expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074930.199504:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074930.199524:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.199526:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074930.199573:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.199592:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074930.199608:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074930.199676:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616171008:12345-192.168.204.32@tcp:101:cp.0 Request processed in 234us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074930.199683:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2797 00000100:00100000:1.0:1769074930.205998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.206093:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171136 00000100:00100000:3.0:1769074930.206104:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171136 00000100:00100000:3.0:1769074930.206218:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2798 00000100:00100000:3.0:1769074930.206228:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67696:x1855007616171136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.206245:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.206262:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b752 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.206292:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.206300:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.206302:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.206306:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b752 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.206340:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.206360:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:3.0:1769074930.206374:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626635648:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074930.206472:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161784e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1769074930.208361:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626635648:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074930.208404:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b752 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.208422:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8200, rc 0) 00000100:00100000:3.0:1769074930.208479:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67696:x1855007616171136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2252us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074930.208488:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2798 00000100:00100000:0.0:1769074930.214555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.214797:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171264 00000100:00100000:2.0:1769074930.214806:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171264 00010000:00010000:2.0:1769074930.214856:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074930.214888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1926 00000100:00100000:2.0:1769074930.214896:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2420:x1855007616171264:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074930.214911:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074930.215017:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.215030:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.215048:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f48c800/0x557988ac98febbb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b74b expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.215060:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.215062:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.215076:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b752 expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.215086:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b752 expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.215128:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8200/0x557988ac98febbbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b752 expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074930.215142:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f970e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626635776:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074930.215338:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043c700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074930.219918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.220003:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f970e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626635776:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074930.220028:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074930.220097:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616171264:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5197us (5563us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.220109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1926 00000100:00100000:0.0:1769074930.220136:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171520 00000100:00100000:0.0:1769074930.220144:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171520 00000100:00100000:0.0:1769074930.220192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1911 00000100:00100000:0.0:1769074930.220201:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+358:67696:x1855007616171520:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074930.220482:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67696:x1855007616171520:12345-192.168.204.32@tcp:35:cp.0 Request processed in 281us (571us total) trans 4294969111 rc 0/0 00000100:00100000:0.0:1769074930.220489:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1911 00000100:00100000:1.0:1769074930.252887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.252959:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171648 00000100:00100000:0.0:1769074930.252972:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171648 00000100:00100000:0.0:1769074930.253044:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9662 00000100:00100000:0.0:1769074930.253053:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67699:x1855007616171648:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074930.253083:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.253105:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbc4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b759 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.253175:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.253188:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253199:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253214:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.253221:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253227:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253287:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253294:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253300:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253307:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253313:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.253316:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253327:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253339:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.253342:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.253349:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253355:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbcb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253369:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253374:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253380:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253384:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.253387:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253393:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253400:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f3c6b00) 00010000:00010000:0.0:1769074930.253403:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.253406:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253411:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbd2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.253442:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbc4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b759 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.253452:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.253454:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.253457:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b759 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.253464:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074930.253586:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67699:x1855007616171648:12345-192.168.204.32@tcp:101:bash.0 Request processed in 533us (709us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.253593:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9662 00000100:00100000:2.0:1769074930.267395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.267499:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171776 00000100:00100000:0.0:1769074930.267512:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171776 00000100:00100000:0.0:1769074930.267617:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9663 00000100:00100000:0.0:1769074930.267628:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67700:x1855007616171776:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074930.267656:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.267679:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b760 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.267747:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.267762:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267774:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267790:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.267795:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267800:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267858:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267866:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267871:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267876:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267882:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.267885:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267892:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267904:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.267907:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.267912:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267918:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febbe0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267932:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267939:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267944:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267948:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.267950:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267955:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267962:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f3c6b00) 00010000:00010000:0.0:1769074930.267964:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.267967:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267971:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febbe7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.267999:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbd9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b760 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.268008:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.268010:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.268013:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febbd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b760 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.268026:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074930.268087:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67700:x1855007616171776:12345-192.168.204.32@tcp:101:rm.0 Request processed in 462us (703us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.268095:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9663 00000100:00100000:1.0:1769074930.270179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.270403:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616171904 00000100:00100000:2.0:1769074930.270413:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616171904 00000100:00100000:2.0:1769074930.270470:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 240 00000100:00100000:2.0:1769074930.270480:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:2419:x1855007616171904:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074930.270579:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.270599:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febbee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b767 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.270656:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.270670:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270680:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270695:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.270701:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270706:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270752:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270763:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270769:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270776:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.270780:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270786:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270797:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.270800:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.270804:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270809:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febbf5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270821:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270827:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270832:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270837:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.270839:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270845:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270851:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.270853:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.270856:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270861:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febbfc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.270887:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febbee lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b767 expref: 360 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.270896:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.270898:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074930.270902:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febbee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b767 expref: 360 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.270909:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc -2) 00000100:00100000:2.0:1769074930.270978:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:2419:x1855007616171904:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 498us (806us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074930.270987:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 240 00000100:00100000:1.0:1769074930.277505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.277660:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172032 00000100:00100000:3.0:1769074930.277671:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172032 00000100:00100000:3.0:1769074930.277747:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9664 00000100:00100000:3.0:1769074930.277757:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67700:x1855007616172032:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074930.277777:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.277799:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc03 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b79f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.277862:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.277877:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277888:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277906:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.277913:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277920:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277970:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277978:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277985:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.277991:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.277995:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278002:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278014:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.278018:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.278022:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278028:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febc0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278040:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278047:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278053:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278057:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.278060:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278075:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278082:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff916052a4f500) 00010000:00010000:3.0:1769074930.278085:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.278088:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278093:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.278123:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc03 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b79f expref: 360 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.278135:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.278137:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.278141:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b79f expref: 360 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.278154:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc 0) 00000100:00100000:3.0:1769074930.278216:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67700:x1855007616172032:12345-192.168.204.32@tcp:101:rm.0 Request processed in 460us (721us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.278222:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9664 00000100:00100000:0.0:1769074930.290999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.291328:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172160 00000100:00100000:2.0:1769074930.291340:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172160 00000100:00100000:2.0:1769074930.291397:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9665 00000100:00100000:2.0:1769074930.291407:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67703:x1855007616172160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.291428:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.291450:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febc18 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7a6 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074930.291914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1769074930.292083:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.292100:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292112:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292129:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.292135:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292141:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292194:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292201:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292207:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292212:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292218:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.292223:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292230:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292241:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.292244:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.292249:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292255:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98febc1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292269:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292276:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292282:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292286:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.292289:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292294:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292302:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.292304:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.292307:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292312:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98febc26 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.292342:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febc18 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7a6 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.292352:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.292356:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.292359:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febc18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7a6 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.292367:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc 0) 00000100:00100000:2.0:1769074930.292430:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67703:x1855007616172160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1024us (1442us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.292438:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9665 00000100:00100000:3.0:1769074930.292657:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172288 00000100:00100000:3.0:1769074930.292664:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172288 00000100:00100000:3.0:1769074930.292711:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 241 00000100:00100000:3.0:1769074930.293211:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:2420:x1855007616172288:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074930.293365:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.293378:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc2d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7ad expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.293424:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.293435:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293444:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293457:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.293463:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293469:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293780:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293791:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293796:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293801:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.293805:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293811:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293821:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.293823:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.293826:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293831:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febc34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293842:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293847:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293852:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293858:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.293861:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293870:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293876:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff91604f4f6700) 00010000:00010000:2.0:1769074930.293879:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.293881:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293886:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.293913:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc2d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7ad expref: 360 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.293922:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.293924:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074930.293928:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7ad expref: 360 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.293937:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280600, rc -2) 00000100:00100000:2.0:1769074930.294055:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:2420:x1855007616172288:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1335us (2142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074930.294072:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 241 00000100:00100000:1.0:1769074930.298046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.298131:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172416 00000100:00100000:2.0:1769074930.298142:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172416 00000100:00100000:2.0:1769074930.298199:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9666 00000100:00100000:2.0:1769074930.298208:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67703:x1855007616172416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.298238:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.298259:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc42 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7e5 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.298330:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.298346:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298358:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298374:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.298381:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298387:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298436:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298443:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298449:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298455:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298461:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.298465:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298473:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298484:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.298487:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.298506:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298512:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298525:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298822:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298829:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298834:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.298837:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298843:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298851:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f4f6d00) 00010000:00010000:2.0:1769074930.298853:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.298856:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298862:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.298897:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc42 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7e5 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.298907:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.298909:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.298913:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc42 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7e5 expref: 360 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.298921:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280c00, rc 0) 00000100:00100000:2.0:1769074930.298985:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67703:x1855007616172416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 777us (948us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.298992:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9666 00000100:00100000:0.0:1769074930.306118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.306207:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172672 00000100:00100000:2.0:1769074930.306217:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172672 00000100:00100000:2.0:1769074930.306283:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9667 00000100:00100000:2.0:1769074930.306293:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+359:67703:x1855007616172672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.306314:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.306335:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc57 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7ec expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.306448:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.306463:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.306474:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.306491:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.306498:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.306504:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:2.0:1769074930.306819:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xca:0x0], index 1: 0 00010000:00010000:2.0:1769074930.306970:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc6c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.306979:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc6c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.306986:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc6c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307019:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307025:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307031:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307038:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307044:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.307048:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307056:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307079:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.307082:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.307088:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307093:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98febc5e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:2.0:1769074930.307106:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000abada8fc reply state 0000000010fe1aaf transno 4294969112 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307115:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.307120:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f4f6d00) 00010000:00010000:2.0:1769074930.307123:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074930.307125:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074930.307153:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98febc57 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7ec expref: 362 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.307166:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280c00/0x557988ac98febc6c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7ec expref: 361 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.307173:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19d:0x0].0x0 (ffff91604f4f6700) 00010000:00010000:2.0:1769074930.307174:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074930.307177:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280c00, rc 0) 00000100:00100000:2.0:1769074930.307244:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+362:67703:x1855007616172672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 952us (1136us total) trans 4294969112 rc 0/0 00000100:00100000:2.0:1769074930.307256:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9667 00000100:00100000:1.0:1769074930.311457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.311685:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172800 00000100:00100000:3.0:1769074930.311696:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172800 00000100:00100000:3.0:1769074930.311748:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2799 00000100:00100000:3.0:1769074930.311758:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+179:2419:x1855007616172800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.311777:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.311798:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7f3 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074930.311821:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074930.311842:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.311844:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.311852:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.311870:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 180 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.311887:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc 0) 00000100:00100000:3.0:1769074930.312144:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616172800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 386us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074930.312153:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2799 00000100:00100000:1.0:1769074930.316290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.316376:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616172928 00000100:00100000:3.0:1769074930.316387:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616172928 00000100:00100000:3.0:1769074930.316447:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2800 00000100:00100000:3.0:1769074930.316456:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67703:x1855007616172928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.316474:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.316492:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b7fa expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.316523:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.316571:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.316573:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.316577:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7fa expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.316613:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 181 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.316627:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 181 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:3.0:1769074930.316647:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626635904:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074930.316979:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9161784e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1769074930.320479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.320625:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173056 00000100:00100000:2.0:1769074930.320635:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173056 00010000:00010000:2.0:1769074930.320701:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074930.320741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1927 00000100:00100000:2.0:1769074930.320751:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616173056:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074930.320766:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074930.320787:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.320801:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:2.0:1769074930.320825:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.320827:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.320835:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7fa expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.320846:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7fa expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.320884:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7fa expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074930.320898:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626636032:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074930.320984:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043df2540 going to sleep for 11 seconds 00010000:00010000:3.0:1769074930.325647:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b9200/0x557988ac98febc7a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7f3 expref: 182 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:3.0:1769074930.325669:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626635904:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074930.325775:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8e00/0x557988ac98febc81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b7fa expref: 181 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.325792:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8e00, rc 0) 00000100:00100000:0.0:1769074930.326268:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626636032:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074930.329585:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074930.329659:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616173056:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8904us (9183us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074930.329681:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1927 00000100:00100000:2.0:1769074930.332616:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:67703:x1855007616172928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 16149us (16325us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.332629:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2800 00000100:00100000:1.0:1769074930.337087:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.337187:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173312 00000100:00100000:0.0:1769074930.337198:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173312 00000100:00100000:0.0:1769074930.337271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1912 00000100:00100000:0.0:1769074930.337282:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+362:67703:x1855007616173312:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074930.337589:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67703:x1855007616173312:12345-192.168.204.32@tcp:35:cp.0 Request processed in 309us (512us total) trans 4294969113 rc 0/0 00000100:00100000:0.0:1769074930.337597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1912 00000100:00100000:0.0:1769074930.365937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.367595:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173440 00000100:00100000:2.0:1769074930.367608:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173440 00000100:00100000:2.0:1769074930.367688:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 242 00000100:00100000:2.0:1769074930.367697:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:2417:x1855007616173440:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074930.367767:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.367788:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b801 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.367843:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.367857:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367868:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367882:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074930.367888:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367894:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367944:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367952:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367958:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367964:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.367968:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367975:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.367986:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.367989:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.367994:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368000:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febc8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368013:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368018:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368025:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368029:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.368031:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368039:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368045:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.368047:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.368050:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368054:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febc96 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074930.368090:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc88 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b801 expref: 364 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.368100:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.368102:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074930.368105:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febc88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b801 expref: 364 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.368113:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc -2) 00000100:00100000:2.0:1769074930.368192:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:2417:x1855007616173440:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 496us (2266us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074930.368199:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 242 00000100:00100000:1.0:1769074930.391260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.391409:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173568 00000100:00100000:3.0:1769074930.391420:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173568 00000100:00100000:3.0:1769074930.391484:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9668 00000100:00100000:3.0:1769074930.391504:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67711:x1855007616173568:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074930.391526:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.391590:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b839 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.391654:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.391670:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391691:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391709:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.391716:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391722:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391776:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391782:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391788:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391794:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.391798:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391805:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391817:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.391820:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.391825:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391831:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febca4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391842:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391848:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391853:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391857:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.391860:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391866:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391872:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916052a4f900) 00010000:00010000:3.0:1769074930.391874:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.391877:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391882:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.391912:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc9d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b839 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.391920:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.391923:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.391926:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febc9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b839 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.391934:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc 0) 00000100:00100000:3.0:1769074930.391988:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67711:x1855007616173568:12345-192.168.204.32@tcp:101:bash.0 Request processed in 497us (738us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.391996:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9668 00000100:00100000:1.0:1769074930.407645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.407751:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173696 00000100:00100000:2.0:1769074930.407762:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173696 00000100:00100000:2.0:1769074930.407823:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9669 00000100:00100000:2.0:1769074930.407833:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67712:x1855007616173696:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074930.407855:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.407876:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcb2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b840 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.407941:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.407955:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.407966:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.407980:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.407986:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.407992:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408046:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408053:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408058:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408094:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408100:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.408104:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408113:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408125:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.408128:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.408132:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408138:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcb9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408152:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408157:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408163:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408168:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.408170:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408176:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408183:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.408185:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.408187:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408192:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.408221:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcb2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b840 expref: 364 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.408242:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.408245:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.408248:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcb2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b840 expref: 364 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.408257:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc 0) 00000100:00100000:2.0:1769074930.408325:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67712:x1855007616173696:12345-192.168.204.32@tcp:101:rm.0 Request processed in 492us (689us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.408332:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9669 00000100:00100000:0.0:1769074930.412709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.412843:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173824 00000100:00100000:3.0:1769074930.412854:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173824 00000100:00100000:3.0:1769074930.412910:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 243 00000100:00100000:3.0:1769074930.412920:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:2419:x1855007616173824:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074930.412955:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.412976:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febcc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b847 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.413033:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074930.413048:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413059:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413083:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074930.413090:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413097:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413146:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413153:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413164:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413170:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.413174:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413182:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413195:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.413199:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.413203:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413209:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febcce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413233:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413240:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413246:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413251:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.413254:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413260:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413272:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff916052a4f900) 00010000:00010000:3.0:1769074930.413275:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.413278:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413283:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febcd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074930.413310:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febcc7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b847 expref: 364 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.413321:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.413323:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074930.413327:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febcc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b847 expref: 364 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.413335:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc -2) 00000100:00100000:3.0:1769074930.413400:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:2419:x1855007616173824:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 481us (700us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074930.413409:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 243 00000100:00100000:1.0:1769074930.417781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.418156:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616173952 00000100:00100000:3.0:1769074930.418167:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616173952 00000100:00100000:3.0:1769074930.418236:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9670 00000100:00100000:3.0:1769074930.418246:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67712:x1855007616173952:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074930.418268:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.418289:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febcdc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b84e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.418364:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.418379:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418389:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418403:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.418410:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418417:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418468:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418475:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418482:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418487:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.418502:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418510:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418526:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.418565:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.418571:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418578:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febce3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418591:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418596:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418601:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418607:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.418610:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418616:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418623:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916052a4f000) 00010000:00010000:3.0:1769074930.418626:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.418629:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418633:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febcea lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.418666:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febcdc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b84e expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.418679:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.418681:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.418685:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febcdc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b84e expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.418693:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074930.418747:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67712:x1855007616173952:12345-192.168.204.32@tcp:101:rm.0 Request processed in 502us (975us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.418755:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9670 00000100:00100000:1.0:1769074930.435372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.435662:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174080 00000100:00100000:2.0:1769074930.435681:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174080 00000100:00100000:2.0:1769074930.435746:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9671 00000100:00100000:2.0:1769074930.435755:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67713:x1855007616174080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.435775:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.435798:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcf1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b855 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.435869:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.435885:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.435896:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.435915:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.435922:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.435928:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.435979:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.435986:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436003:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436009:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436014:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.436018:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436025:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436036:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.436040:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.436045:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436050:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febcf8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436073:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436079:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436084:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436088:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.436091:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436096:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436103:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff91604f4f6100) 00010000:00010000:2.0:1769074930.436106:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.436108:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436114:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281400/0x557988ac98febcff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.436143:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcf1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b855 expref: 364 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.436152:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.436154:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.436157:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98febcf1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b855 expref: 364 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.436171:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc 0) 00000100:00100000:2.0:1769074930.436243:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67713:x1855007616174080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 489us (879us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.436250:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9671 00000100:00100000:0.0:1769074930.440236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.440319:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174208 00000100:00100000:3.0:1769074930.440330:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174208 00000100:00100000:3.0:1769074930.440388:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9672 00000100:00100000:3.0:1769074930.440398:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67713:x1855007616174208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.440417:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.440437:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd06 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b85c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.440514:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.440528:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440574:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440589:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.440600:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440607:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440660:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440668:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440899:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440906:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.440910:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440917:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440930:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.440933:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.440937:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440943:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440956:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440962:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440968:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440973:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.440977:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440983:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.440990:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916052a4f000) 00010000:00010000:3.0:1769074930.440992:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.440995:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.441000:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd14 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.441033:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd06 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b85c expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.441043:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.441045:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.441048:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b85c expref: 364 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.441057:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074930.441170:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67713:x1855007616174208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 772us (953us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.441178:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9672 00000100:00100000:1.0:1769074930.445875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.446024:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174464 00000100:00100000:3.0:1769074930.446033:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174464 00000100:00100000:3.0:1769074930.446103:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9673 00000100:00100000:3.0:1769074930.446113:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+363:67713:x1855007616174464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.446133:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.446153:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd1b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b863 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.446381:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.446396:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.446407:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.446419:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xcb234504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.446426:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.446432:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074930.447118:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xca:0x0], index 0: 0 00010000:00010000:3.0:1769074930.447366:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd30 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.447380:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd30 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447389:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd30 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447424:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447431:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447438:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447443:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.447447:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447454:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447466:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.447470:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.447474:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447480:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd22 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074930.447640:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bd324cb8 reply state 00000000a1bff719 transno 4294969114 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447654:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.447661:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916052a4f900) 00010000:00010000:3.0:1769074930.447664:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074930.447668:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074930.447712:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd1b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b863 expref: 366 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.447727:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9c00/0x557988ac98febd30 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b863 expref: 365 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.447734:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19e:0x0].0x0 (ffff916052a4f000) 00010000:00010000:3.0:1769074930.447737:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074930.447740:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9c00, rc 0) 00000100:00100000:3.0:1769074930.447811:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+366:67713:x1855007616174464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1699us (1943us total) trans 4294969114 rc 0/0 00000100:00100000:3.0:1769074930.447820:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9673 00000100:00100000:0.0:1769074930.452271:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.452414:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174592 00000100:00100000:2.0:1769074930.452425:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174592 00000100:00100000:2.0:1769074930.452484:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2801 00000100:00100000:2.0:1769074930.452503:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616174592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.452520:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.452567:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b86a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074930.452591:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074930.452610:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.452612:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.452620:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.452635:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 182 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.452647:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc 0) 00000100:00100000:2.0:1769074930.452720:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616174592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 226us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.452726:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2801 00000100:00100000:0.0:1769074930.457341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.457498:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174720 00000100:00100000:2.0:1769074930.457509:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174720 00000100:00100000:2.0:1769074930.457595:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2802 00000100:00100000:2.0:1769074930.457604:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67713:x1855007616174720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.457622:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.457640:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b871 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.457672:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.457680:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.457682:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.457686:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b871 expref: 183 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.457722:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.457736:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074930.457749:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f971880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626636160:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074930.457839:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043df2540 going to sleep for 11 seconds 00000100:00100000:1.0:1769074930.461125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.461408:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f971880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626636160:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074930.461441:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b871 expref: 183 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.461467:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281400, rc 0) 00000100:00100000:2.0:1769074930.461626:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67713:x1855007616174720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4022us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.461635:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2802 00000100:00100000:0.0:1769074930.461824:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616174848 00000100:00100000:0.0:1769074930.461833:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616174848 00010000:00010000:0.0:1769074930.461880:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 2019 lvb_type: 1 00000100:00100000:0.0:1769074930.461917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1928 00000100:00100000:0.0:1769074930.461925:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616174848:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074930.461937:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074930.461959:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:0.0:1769074930.461971:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:0.0:1769074930.461997:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febd3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b86a expref: 183 pid: 24564 timeout: 2019 lvb_type: 1 00010000:00010000:0.0:1769074930.462011:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.462013:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.462020:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b871 expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.462030:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b871 expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.462081:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281400/0x557988ac98febd45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b871 expref: 182 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074930.462099:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626636288:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074930.464638:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074930.469461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.469580:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626636288:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074930.469603:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074930.469659:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2419:x1855007616174848:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7734us (8545us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074930.469678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1928 00000100:00100000:3.0:1769074930.469853:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175104 00000100:00100000:3.0:1769074930.469861:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175104 00000100:00100000:3.0:1769074930.469908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1913 00000100:00100000:3.0:1769074930.469917:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+366:67713:x1855007616175104:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074930.470181:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67713:x1855007616175104:12345-192.168.204.32@tcp:35:cp.0 Request processed in 264us (728us total) trans 4294969115 rc 0/0 00000100:00100000:3.0:1769074930.470188:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1913 00000100:00100000:1.0:1769074930.525153:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.525435:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175232 00000100:00100000:3.0:1769074930.525445:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175232 00000100:00100000:3.0:1769074930.525516:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9674 00000100:00100000:3.0:1769074930.525526:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67716:x1855007616175232:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074930.525584:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.525605:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd4c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b878 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.525692:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.525707:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525720:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525734:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.525740:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525747:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525799:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525807:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525813:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525819:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.525824:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525831:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525848:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.525851:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.525856:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525863:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525874:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525880:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525886:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525890:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.525893:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525899:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525906:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff916052a4ff00) 00010000:00010000:3.0:1769074930.525908:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.525911:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525917:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd5a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.525947:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd4c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b878 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.525958:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.525960:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.525963:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b878 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.525972:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc 0) 00000100:00100000:3.0:1769074930.526036:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67716:x1855007616175232:12345-192.168.204.32@tcp:101:bash.0 Request processed in 511us (891us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.526044:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9674 00000100:00100000:1.0:1769074930.539950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.540000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.540102:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175360 00000100:00100000:2.0:1769074930.540114:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175360 00000100:00100000:2.0:1769074930.540178:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9675 00000100:00100000:2.0:1769074930.540188:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67717:x1855007616175360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074930.540213:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.540244:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febd61 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b87f expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.540310:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.540325:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540335:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540351:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:2.0:1769074930.540357:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540362:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540417:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540424:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540430:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540436:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540442:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.540446:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540454:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540465:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.540469:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.540474:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540480:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281800/0x557988ac98febd68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540494:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540500:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540505:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540511:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074930.540514:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540519:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540525:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff91604f4f6900) 00010000:00010000:2.0:1769074930.540528:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.540581:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540587:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281600/0x557988ac98febd6f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:2.0:1769074930.540617:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febd61 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b87f expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.540626:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074930.540629:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074930.540632:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280600/0x557988ac98febd61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b87f expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.540641:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280600, rc 0) 00000100:00100000:2.0:1769074930.540695:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67717:x1855007616175360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 508us (755us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074930.540702:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9675 00000100:00100000:3.0:1769074930.541098:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175488 00000100:00100000:3.0:1769074930.541104:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175488 00000100:00100000:3.0:1769074930.541145:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 244 00000100:00100000:3.0:1769074930.541153:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:2418:x1855007616175488:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074930.541176:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.541188:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b886 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.541231:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.541241:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541249:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541262:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.541274:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541280:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541309:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541316:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541322:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541328:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.541331:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541337:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541347:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.541350:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.541353:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541358:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febd7d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541367:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541374:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541380:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541385:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.541388:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541393:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541399:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff916052a4ff00) 00010000:00010000:3.0:1769074930.541401:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.541404:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541409:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febd84 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.541430:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd76 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b886 expref: 368 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.541437:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.541440:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074930.541443:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febd76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b886 expref: 368 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.541451:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc -2) 00000100:00100000:3.0:1769074930.541500:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:2418:x1855007616175488:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 348us (1498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074930.541508:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 244 00000100:00100000:1.0:1769074930.547419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.547505:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175616 00000100:00100000:3.0:1769074930.547514:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175616 00000100:00100000:3.0:1769074930.547584:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9676 00000100:00100000:3.0:1769074930.547591:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67717:x1855007616175616:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074930.547608:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.547626:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd8b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b88d expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.547692:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.547702:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547710:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547718:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.547722:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547726:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547767:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547771:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547775:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547780:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.547783:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547788:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547796:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.547798:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.547801:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547805:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febd92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547813:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547817:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547820:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547823:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.547824:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547827:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547830:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff916052a4fe00) 00010000:00010000:3.0:1769074930.547832:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.547834:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547837:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febd99 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.547872:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd8b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b88d expref: 368 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.547881:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.547883:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.547887:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febd8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b88d expref: 368 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.547896:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc 0) 00000100:00100000:3.0:1769074930.547956:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67717:x1855007616175616:12345-192.168.204.32@tcp:101:rm.0 Request processed in 364us (546us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.547963:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9676 00000100:00100000:2.0:1769074930.563798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.563977:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175744 00000100:00100000:0.0:1769074930.563987:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175744 00000100:00100000:0.0:1769074930.564046:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9677 00000100:00100000:0.0:1769074930.564055:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67718:x1855007616175744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.564085:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.564106:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febda0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b894 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.564172:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.564186:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564197:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564212:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.564219:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564368:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564420:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564427:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564433:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564439:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564445:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.564449:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564456:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564467:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.564470:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.564474:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564480:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febda7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564493:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564499:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564505:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564510:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.564513:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564519:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564526:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074930.564528:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.564623:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564629:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febdae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.564663:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febda0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b894 expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.564685:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.564688:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.564692:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febda0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b894 expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.564701:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074930.564753:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67718:x1855007616175744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 698us (964us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.564760:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9677 00000100:00100000:1.0:1769074930.569976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.570046:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616175872 00000100:00100000:0.0:1769074930.570055:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616175872 00000100:00100000:0.0:1769074930.570126:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9678 00000100:00100000:0.0:1769074930.570136:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67718:x1855007616175872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.570155:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.570176:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febdb5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b89b expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.570256:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.570271:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570282:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570296:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.570303:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570310:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570360:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570367:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570373:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570383:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570390:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.570393:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570401:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570412:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.570415:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.570419:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570425:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febdbc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570438:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570443:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570448:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570453:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.570455:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570460:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570471:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff91604e0bea00) 00010000:00010000:0.0:1769074930.570473:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.570476:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570481:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febdc3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.570511:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febdb5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b89b expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.570520:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.570522:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.570525:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febdb5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b89b expref: 368 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.570571:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074930.570633:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67718:x1855007616175872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 499us (666us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.570640:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9678 00000100:00100000:1.0:1769074930.575747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.575894:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176128 00000100:00100000:3.0:1769074930.575904:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176128 00000100:00100000:3.0:1769074930.575993:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9679 00000100:00100000:3.0:1769074930.576004:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+367:67718:x1855007616176128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.576026:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.576047:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febdca lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8a2 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.576174:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.576190:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576201:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576216:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.576235:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576241:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:3.0:1769074930.576585:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xcb:0x0], index 1: 0 00010000:00010000:3.0:1769074930.576744:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febddf lrc: 3/1,0 mode: --/PR res: [0x240000403:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.576754:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febddf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576761:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febddf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576792:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576800:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576807:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576813:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.576818:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576825:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576837:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.576841:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.576845:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576851:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febdd1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:3.0:1769074930.576862:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001973396d reply state 00000000cded9b66 transno 4294969116 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576873:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.576878:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff916052a4fe00) 00010000:00010000:3.0:1769074930.576880:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074930.576883:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074930.576911:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febdca lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a2 expref: 370 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.576925:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9200/0x557988ac98febddf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a2 expref: 369 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.576932:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x19f:0x0].0x0 (ffff916052a4ff00) 00010000:00010000:3.0:1769074930.576934:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074930.576937:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9200, rc 0) 00000100:00100000:3.0:1769074930.576997:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+370:67718:x1855007616176128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 995us (1259us total) trans 4294969116 rc 0/0 00000100:00100000:3.0:1769074930.577008:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9679 00000100:00100000:2.0:1769074930.588766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.588964:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176256 00000100:00100000:0.0:1769074930.588977:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176256 00000100:00100000:0.0:1769074930.589098:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2803 00000100:00100000:0.0:1769074930.589113:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+180:2419:x1855007616176256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.589131:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.589154:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8a9 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074930.589184:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074930.589204:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.589206:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.589214:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074930.589244:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 181 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074930.589257:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074930.589317:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2419:x1855007616176256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 206us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074930.589325:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2803 00000100:00100000:1.0:1769074930.595078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.595173:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176384 00000100:00100000:2.0:1769074930.595185:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176384 00000100:00100000:2.0:1769074930.595256:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2804 00000100:00100000:2.0:1769074930.595267:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:67718:x1855007616176384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.595287:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.595306:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8b0 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.595346:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.595355:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.595357:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.595360:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b0 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.595397:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 182 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.595411:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 182 pid: 25313 timeout: 2019 lvb_type: 1 00000100:00100000:2.0:1769074930.595425:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043558a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626636416:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074930.595517:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916043df2540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074930.598748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.598823:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176512 00000100:00100000:0.0:1769074930.598833:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176512 00010000:00010000:0.0:1769074930.598895:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 183 pid: 25313 timeout: 2019 lvb_type: 1 00000100:00100000:0.0:1769074930.598932:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1929 00000100:00100000:0.0:1769074930.598941:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2420:x1855007616176512:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074930.598957:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074930.598992:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 183 pid: 25313 timeout: 2019 lvb_type: 1 00010000:00010000:0.0:1769074930.599009:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 183 pid: 25313 timeout: 2019 lvb_type: 1 00010000:00010000:0.0:1769074930.599034:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.599037:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.599044:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b0 expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.599053:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b0 expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.599098:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b0 expref: 183 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074930.599111:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626636544:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074930.599197:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1769074930.601168:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfbe00/0x557988ac98febded lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8a9 expref: 183 pid: 25313 timeout: 2019 lvb_type: 1 00000100:00100000:1.0:1769074930.601187:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043558a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626636416:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074930.601215:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e281800/0x557988ac98febdf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b0 expref: 182 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.601244:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281800, rc 0) 00000100:00100000:1.0:1769074930.601309:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:67718:x1855007616176384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6043us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074930.601318:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2804 00000100:00100000:0.0:1769074930.614774:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626636544:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074930.614808:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074930.615350:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616176512:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 16406us (16610us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074930.615362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1929 00000100:00100000:3.0:1769074930.619025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.619126:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176768 00000100:00100000:0.0:1769074930.619136:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176768 00000100:00100000:0.0:1769074930.619193:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1914 00000100:00100000:0.0:1769074930.619201:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+370:67718:x1855007616176768:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074930.620000:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67718:x1855007616176768:12345-192.168.204.32@tcp:35:cp.0 Request processed in 796us (979us total) trans 4294969117 rc 0/0 00000100:00100000:0.0:1769074930.620009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1914 00000100:00100000:2.0:1769074930.668948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.669031:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616176896 00000100:00100000:3.0:1769074930.669042:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616176896 00000100:00100000:3.0:1769074930.669116:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9680 00000100:00100000:3.0:1769074930.669126:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67722:x1855007616176896:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074930.669147:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.669168:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febdfb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8b7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.669243:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.669258:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669270:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669283:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.669290:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669296:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669349:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669355:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669361:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669367:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.669371:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669378:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669389:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.669392:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.669397:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669402:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669414:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669420:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669425:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669430:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.669433:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669438:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669450:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052a4f400) 00010000:00010000:3.0:1769074930.669452:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.669455:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669460:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.669501:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febdfb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b7 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.669512:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.669515:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.669518:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febdfb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8b7 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.669527:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc 0) 00000100:00100000:3.0:1769074930.669631:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67722:x1855007616176896:12345-192.168.204.32@tcp:101:bash.0 Request processed in 506us (691us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.669640:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9680 00000100:00100000:2.0:1769074930.686957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.687041:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177024 00000100:00100000:0.0:1769074930.687052:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177024 00000100:00100000:0.0:1769074930.687115:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9681 00000100:00100000:0.0:1769074930.687123:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67723:x1855007616177024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074930.687147:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.687165:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8be expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.687237:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.687251:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687261:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687275:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.687282:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687287:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687336:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687343:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687349:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687358:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687364:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.687368:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687375:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687386:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.687389:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.687393:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687398:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe17 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687412:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687417:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687422:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687427:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.687430:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687435:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687446:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff91604f3c6b00) 00010000:00010000:0.0:1769074930.687448:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.687451:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687456:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.687487:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe10 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8be expref: 372 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.687496:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.687498:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.687501:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8be expref: 372 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.687509:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074930.687609:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67723:x1855007616177024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 485us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.687616:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9681 00000100:00100000:1.0:1769074930.689923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.689990:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177152 00000100:00100000:0.0:1769074930.689999:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177152 00000100:00100000:0.0:1769074930.690048:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 245 00000100:00100000:0.0:1769074930.690065:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:2419:x1855007616177152:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074930.690118:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.690135:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febe25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8c5 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.690188:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074930.690201:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690211:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690235:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074930.690242:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690248:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690287:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690294:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690299:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690305:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.690309:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690315:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690330:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.690333:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.690336:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690341:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febe2c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690353:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690359:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690365:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690369:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.690372:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690377:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690383:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff916052b4cf00) 00010000:00010000:0.0:1769074930.690385:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.690387:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690393:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febe33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.690417:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febe25 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8c5 expref: 372 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.690426:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.690428:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074930.690431:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febe25 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8c5 expref: 372 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.690438:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc -2) 00000100:00100000:0.0:1769074930.690494:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:2419:x1855007616177152:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 438us (578us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074930.690501:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 245 00000100:00100000:1.0:1769074930.694629:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.694777:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177280 00000100:00100000:0.0:1769074930.694789:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177280 00000100:00100000:0.0:1769074930.694855:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9682 00000100:00100000:0.0:1769074930.694865:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67723:x1855007616177280:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074930.694886:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.694906:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe3a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b8fd expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.694971:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074930.694986:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.694997:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695010:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074930.695020:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695026:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695085:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695092:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695098:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695104:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.695107:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695114:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695126:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.695129:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.695133:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695138:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695150:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695155:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695161:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695166:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.695168:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695174:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695180:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052b4c700) 00010000:00010000:0.0:1769074930.695182:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.695185:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695190:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe48 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074930.695233:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe3a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8fd expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.695242:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.695245:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.695248:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b8fd expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.695262:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074930.695314:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67723:x1855007616177280:12345-192.168.204.32@tcp:101:rm.0 Request processed in 450us (695us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.695321:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9682 00000100:00100000:2.0:1769074930.723212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.723383:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177408 00000100:00100000:0.0:1769074930.723394:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177408 00000100:00100000:0.0:1769074930.723452:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9683 00000100:00100000:0.0:1769074930.723462:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67726:x1855007616177408:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.723480:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.723500:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b904 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.723600:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.723614:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723625:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723638:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.723644:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723650:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723701:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723709:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723715:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723725:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723730:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.723734:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723740:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723752:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.723755:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.723760:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723764:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723774:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723777:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723781:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723784:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.723785:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723788:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723796:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052b4c700) 00010000:00010000:0.0:1769074930.723797:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.723799:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723802:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe5d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.723826:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe4f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b904 expref: 372 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.723833:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.723835:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.723837:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b904 expref: 372 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.723842:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074930.723894:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67726:x1855007616177408:12345-192.168.204.32@tcp:101:cp.0 Request processed in 433us (689us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.723901:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9683 00000100:00100000:1.0:1769074930.724811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.725457:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177536 00000100:00100000:3.0:1769074930.725466:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177536 00000100:00100000:3.0:1769074930.725515:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 246 00000100:00100000:3.0:1769074930.725524:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:2417:x1855007616177536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074930.725608:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.725625:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe64 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b90b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.725676:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.725688:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725698:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725710:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074930.725716:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725722:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725763:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725769:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725775:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725781:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.725785:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725792:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725805:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.725808:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.725812:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725817:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725828:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725834:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725839:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725844:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.725846:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725851:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725857:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff916052a4f400) 00010000:00010000:3.0:1769074930.725859:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.725862:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725867:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe72 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074930.725890:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe64 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b90b expref: 372 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.725899:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.725901:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074930.725904:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b90b expref: 372 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.725912:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc -2) 00000100:00100000:3.0:1769074930.726313:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:2417:x1855007616177536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 787us (1503us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074930.726321:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 246 00000100:00100000:1.0:1769074930.732470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.732565:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177664 00000100:00100000:3.0:1769074930.732575:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177664 00000100:00100000:3.0:1769074930.732618:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9684 00000100:00100000:3.0:1769074930.732626:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67726:x1855007616177664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.732645:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.732663:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe79 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b943 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.732721:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.732734:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732745:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732757:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.732768:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732774:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732817:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732824:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732830:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732836:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.732840:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732847:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732857:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.732859:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.732863:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732869:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febe80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732879:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732884:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732891:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732895:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.732898:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732903:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732909:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052a4f400) 00010000:00010000:3.0:1769074930.732911:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.732913:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732918:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febe87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.732943:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe79 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b943 expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.732952:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.732954:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.732958:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9400/0x557988ac98febe79 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b943 expref: 372 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.732966:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc 0) 00000100:00100000:3.0:1769074930.733069:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67726:x1855007616177664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 443us (608us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.733077:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9684 00000100:00100000:2.0:1769074930.738743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.738817:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616177920 00000100:00100000:0.0:1769074930.738826:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616177920 00000100:00100000:0.0:1769074930.738873:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9685 00000100:00100000:0.0:1769074930.738879:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+371:67726:x1855007616177920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.738896:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.738913:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe8e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b94a expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.739014:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.739026:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739034:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739043:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.739047:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739050:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074930.739502:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xcb:0x0], index 0: 0 00010000:00010000:0.0:1769074930.739882:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febea3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.739892:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febea3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739897:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febea3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739919:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739923:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739930:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739935:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739938:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.739941:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739945:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739953:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.739955:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.739958:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739961:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febe95 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074930.739969:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000df63db80 reply state 000000000dbea99c transno 4294969118 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739976:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.739979:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052b4c700) 00010000:00010000:0.0:1769074930.739981:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074930.739983:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074930.740004:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febe8e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b94a expref: 374 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.740016:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb200/0x557988ac98febea3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b94a expref: 373 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.740020:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a0:0x0].0x0 (ffff916052b4cf00) 00010000:00010000:0.0:1769074930.740022:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074930.740023:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb200, rc 0) 00000100:00100000:0.0:1769074930.741199:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+374:67726:x1855007616177920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2310us (2454us total) trans 4294969118 rc 0/0 00000100:00100000:0.0:1769074930.741211:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9685 00000100:00100000:1.0:1769074930.747337:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.747497:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178048 00000100:00100000:2.0:1769074930.747508:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178048 00000100:00100000:2.0:1769074930.747617:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2805 00000100:00100000:2.0:1769074930.747627:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+182:2418:x1855007616178048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.747647:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.747670:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b951 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074930.747692:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074930.747713:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.747715:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.747724:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.747742:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 183 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.747755:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281a00, rc 0) 00000100:00100000:2.0:1769074930.747819:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2418:x1855007616178048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 193us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.747827:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2805 00000100:00100000:1.0:1769074930.751819:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.751915:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178176 00000100:00100000:3.0:1769074930.751937:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178176 00000100:00100000:3.0:1769074930.752001:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2806 00000100:00100000:3.0:1769074930.752011:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67726:x1855007616178176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.752030:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.752049:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b958 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.752091:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.752100:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.752102:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.752105:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b958 expref: 184 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.752142:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 184 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.752156:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 184 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:3.0:1769074930.752170:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626636672:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074930.752283:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617bb8f300 going to sleep for 11 seconds 00000100:00100000:2.0:1769074930.756198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.756294:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178304 00000100:00100000:0.0:1769074930.756304:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178304 00010000:00010000:0.0:1769074930.756357:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 185 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074930.756397:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1930 00000100:00100000:0.0:1769074930.756407:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2420:x1855007616178304:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074930.756420:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074930.756442:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 185 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074930.756455:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 185 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074930.756479:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.756481:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.756489:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b958 expref: 185 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.756499:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b958 expref: 185 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.756573:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b958 expref: 185 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074930.756588:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626636800:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074930.756678:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614534b600 going to sleep for 11 seconds 00000100:00100000:0.0:1769074930.760124:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626636800:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074930.760153:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074930.760213:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2420:x1855007616178304:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3807us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074930.760233:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1930 00010000:00010000:1.0:1769074930.761430:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e281a00/0x557988ac98febeb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b951 expref: 184 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:1.0:1769074930.761449:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161485f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626636672:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074930.761475:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9400/0x557988ac98febeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b958 expref: 183 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.761490:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9400, rc 0) 00000100:00100000:1.0:1769074930.761580:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:67726:x1855007616178176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 9570us (9774us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074930.761587:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2806 00000100:00100000:2.0:1769074930.766242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.766375:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178560 00000100:00100000:3.0:1769074930.766386:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178560 00000100:00100000:3.0:1769074930.766441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1915 00000100:00100000:3.0:1769074930.766450:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+374:67726:x1855007616178560:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074930.766962:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67726:x1855007616178560:12345-192.168.204.32@tcp:35:cp.0 Request processed in 511us (728us total) trans 4294969119 rc 0/0 00000100:00100000:3.0:1769074930.766971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1915 00000100:00100000:2.0:1769074930.815395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.815506:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178688 00000100:00100000:1.0:1769074930.815517:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178688 00000100:00100000:1.0:1769074930.815602:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 247 00000100:00100000:1.0:1769074930.815611:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:2417:x1855007616178688:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074930.815684:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074930.815711:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febebf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b95f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.815770:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074930.815784:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815796:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815810:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074930.815816:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815821:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815870:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815876:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815881:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815887:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.815891:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815901:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815913:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.815916:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.815921:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815926:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98febec6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815937:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815943:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815948:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815952:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48de00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074930.815954:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815959:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815965:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91604f4f9600) 00010000:00010000:1.0:1769074930.815968:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074930.815970:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.815975:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98febecd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074930.816004:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febebf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b95f expref: 376 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.816012:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074930.816014:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074930.816017:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98febebf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b95f expref: 376 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074930.816024:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc -2) 00000100:00100000:1.0:1769074930.816100:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:2417:x1855007616178688:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 490us (715us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074930.816109:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 247 00000100:00100000:1.0:1769074930.831721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.831949:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178816 00000100:00100000:0.0:1769074930.831960:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178816 00000100:00100000:0.0:1769074930.832024:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9686 00000100:00100000:0.0:1769074930.832033:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67733:x1855007616178816:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074930.832053:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.832085:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febed4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b997 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.832150:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.832164:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832176:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832189:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.832196:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832201:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832263:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832270:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832275:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832281:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832287:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.832291:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832297:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832318:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.832322:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.832327:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832333:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febedb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832345:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832351:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832357:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832361:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.832364:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832369:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832375:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff916052b4c900) 00010000:00010000:0.0:1769074930.832377:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.832380:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832385:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febee2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.832417:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febed4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b997 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.832427:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.832429:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.832432:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febed4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b997 expref: 7 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.832440:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074930.833119:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67733:x1855007616178816:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1084us (1406us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.833128:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9686 00000100:00100000:2.0:1769074930.849571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.849875:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616178944 00000100:00100000:3.0:1769074930.849886:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616178944 00000100:00100000:3.0:1769074930.849995:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9687 00000100:00100000:3.0:1769074930.850006:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67734:x1855007616178944:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074930.850025:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.850046:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febee9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b99e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.850128:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.850141:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850151:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850164:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.850170:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850176:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850228:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850240:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850246:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850252:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.850255:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850262:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850274:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.850277:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.850282:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850288:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febef0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850299:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850316:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850321:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850325:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.850328:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850337:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850344:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff916052a4f400) 00010000:00010000:3.0:1769074930.850346:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.850348:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850354:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febef7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.850391:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febee9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b99e expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.850399:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.850401:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.850404:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febee9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b99e expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.850412:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074930.850474:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67734:x1855007616178944:12345-192.168.204.32@tcp:101:rm.0 Request processed in 470us (953us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.850482:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9687 00000100:00100000:2.0:1769074930.855130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.855232:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179072 00000100:00100000:0.0:1769074930.855242:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179072 00000100:00100000:0.0:1769074930.855446:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 248 00000100:00100000:0.0:1769074930.855458:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:2418:x1855007616179072:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074930.855504:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.855524:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febefe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9a5 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.855601:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074930.855615:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855626:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855639:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074930.855645:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855651:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855887:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855895:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855901:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855907:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.855912:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855918:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855930:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.855934:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.855938:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855943:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855958:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855963:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855968:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855973:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.855977:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855983:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.855989:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff916052b4c900) 00010000:00010000:0.0:1769074930.855992:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.855995:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.856000:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf0c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074930.856031:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febefe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9a5 expref: 376 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.856040:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.856042:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074930.856046:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febefe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9a5 expref: 376 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.856063:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc -2) 00000100:00100000:0.0:1769074930.856213:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:2418:x1855007616179072:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 757us (1092us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074930.856230:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 248 00000100:00100000:1.0:1769074930.864199:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.864781:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179200 00000100:00100000:3.0:1769074930.864794:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179200 00000100:00100000:3.0:1769074930.864858:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9688 00000100:00100000:3.0:1769074930.864867:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67734:x1855007616179200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074930.864887:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.864910:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9ac expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.864972:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.864986:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.864996:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865010:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.865016:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865021:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865081:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865088:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865093:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865098:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.865102:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865109:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865121:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.865125:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.865129:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865134:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865146:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865152:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865158:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865163:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.865165:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865170:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865176:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff916052a4f400) 00010000:00010000:3.0:1769074930.865178:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.865181:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865187:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf21 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.865215:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf13 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9ac expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.865238:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.865240:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.865244:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9ac expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.865252:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074930.865318:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67734:x1855007616179200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 452us (1128us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.865325:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9688 00010000:00010000:1.0:1769074930.867776:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074930.884949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.885047:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179328 00000100:00100000:0.0:1769074930.885066:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179328 00000100:00100000:0.0:1769074930.885124:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9689 00000100:00100000:0.0:1769074930.885133:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67735:x1855007616179328:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.885157:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.885179:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9b3 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.885256:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.885271:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885282:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885295:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.885303:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885309:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885358:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885365:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885371:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885377:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885383:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.885388:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885396:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885407:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.885410:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.885415:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885421:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885434:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885440:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885446:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885452:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.885455:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885461:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885466:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff916052b4c900) 00010000:00010000:0.0:1769074930.885469:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.885472:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885482:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.885527:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf28 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9b3 expref: 376 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.885585:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.885587:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.885591:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9b3 expref: 376 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.885599:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc 0) 00000100:00100000:0.0:1769074930.885662:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67735:x1855007616179328:12345-192.168.204.32@tcp:101:cp.0 Request processed in 529us (721us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074930.885669:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9689 00000100:00100000:2.0:1769074930.891894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.891938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074930.892022:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179456 00000100:00100000:1.0:1769074930.892032:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179456 00002000:00100000:1.0:1769074930.892089:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5a:0x0] (0->157) req@ffff91617fa3f480 x1855007616179456/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.892100:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3f480 with x1855007616179456 ext(0->157) 00002000:00010000:1.0:1769074930.892106:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3f480 00000100:00100000:1.0:1769074930.892137:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179584 00000100:00100000:1.0:1769074930.892140:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179584 00002000:00100000:1.0:1769074930.892156:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5b:0x0] (0->157) req@ffff91604ac92d80 x1855007616179584/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.892164:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92d80 with x1855007616179584 ext(0->157) 00002000:00010000:1.0:1769074930.892169:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92d80 00000100:00100000:1.0:1769074930.892197:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 664 00000100:00100000:1.0:1769074930.892205:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2420:x1855007616179456:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.892828:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 665 00000100:00100000:2.0:1769074930.892839:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+181:2420:x1855007616179584:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.893699:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2420:x1855007616179584:12345-192.168.204.32@tcp:4:cp.0 Request processed in 858us (1754us total) trans 4294967860 rc 0/0 00000100:00100000:2.0:1769074930.893709:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 665 00002000:00100000:2.0:1769074930.893719:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x5b:0x0] (0->157) req@ffff91604ac92d80 x1855007616179584/t4294967860(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.893728:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92d80 with x1855007616179584 ext(0->157) 00002000:00010000:2.0:1769074930.893733:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92d80 00000100:00100000:1.0:1769074930.893766:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2420:x1855007616179456:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1561us (1882us total) trans 4294967848 rc 0/0 00000100:00100000:1.0:1769074930.893774:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 664 00002000:00100000:1.0:1769074930.893785:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5a:0x0] (0->157) req@ffff91617fa3f480 x1855007616179456/t4294967848(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.893793:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3f480 with x1855007616179456 ext(0->157) 00002000:00010000:1.0:1769074930.893796:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3f480 00000100:00100000:2.0:1769074930.900872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.900916:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.900942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.900976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.901004:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179840 00000100:00100000:2.0:1769074930.901014:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179840 00002000:00100000:2.0:1769074930.901070:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5c:0x0] (0->157) req@ffff91604ac93800 x1855007616179840/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.901082:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac93800 with x1855007616179840 ext(0->157) 00002000:00010000:2.0:1769074930.901088:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac93800 00000100:00100000:2.0:1769074930.901109:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179712 00000100:00100000:2.0:1769074930.901112:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179712 00002000:00100000:2.0:1769074930.901129:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5b:0x0] (0->157) req@ffff91604ac92300 x1855007616179712/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.901138:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92300 with x1855007616179712 ext(0->157) 00002000:00010000:2.0:1769074930.901143:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92300 00000100:00100000:2.0:1769074930.901154:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616179968 00000100:00100000:2.0:1769074930.901157:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616179968 00002000:00100000:2.0:1769074930.901169:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5c:0x0] (0->157) req@ffff91604ac91880 x1855007616179968/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.901176:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91880 with x1855007616179968 ext(0->157) 00002000:00010000:2.0:1769074930.901179:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac91880 00000100:00100000:2.0:1769074930.901196:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 666 00000100:00100000:2.0:1769074930.901206:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+183:2419:x1855007616179840:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.901477:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 667 00000100:00100000:0.0:1769074930.901488:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+186:2420:x1855007616179712:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.902944:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2419:x1855007616179840:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1730us (2071us total) trans 4294967861 rc 0/0 00000100:00100000:2.0:1769074930.902957:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 666 00002000:00100000:2.0:1769074930.902966:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x5c:0x0] (0->157) req@ffff91604ac93800 x1855007616179840/t4294967861(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.902975:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac93800 with x1855007616179840 ext(0->157) 00002000:00010000:2.0:1769074930.902981:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac93800 00000100:00100000:2.0:1769074930.903008:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 668 00000100:00100000:2.0:1769074930.903017:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+188:2420:x1855007616179968:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.903595:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181760 00000100:00100000:3.0:1769074930.903603:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181760 00000100:00100000:3.0:1769074930.903648:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9690 00000100:00100000:3.0:1769074930.903655:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67735:x1855007616181760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.903680:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.903701:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9ba expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.903761:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.903776:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903786:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903801:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074930.903812:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903819:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903867:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903874:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903880:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903886:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.903890:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903897:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903909:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.903912:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.903916:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903922:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98febf44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903935:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903940:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903946:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903950:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074930.903953:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903958:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903965:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff916052a4f400) 00010000:00010000:3.0:1769074930.903967:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.903970:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.903976:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98febf4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074930.904008:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf3d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9ba expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.904018:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074930.904020:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074930.904023:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98febf3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9ba expref: 376 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074930.904031:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074930.904080:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67735:x1855007616181760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 426us (3163us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074930.904086:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9690 00000100:00100000:0.0:1769074930.906180:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+188:2420:x1855007616179712:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4685us (5226us total) trans 4294967849 rc 0/0 00000100:00100000:0.0:1769074930.906193:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 667 00002000:00100000:0.0:1769074930.906205:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5b:0x0] (0->157) req@ffff91604ac92300 x1855007616179712/t4294967849(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.906226:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92300 with x1855007616179712 ext(0->157) 00002000:00010000:0.0:1769074930.906233:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92300 00000100:00100000:2.0:1769074930.907930:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+189:2420:x1855007616179968:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4907us (6945us total) trans 4294967850 rc 0/0 00000100:00100000:2.0:1769074930.907943:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 668 00002000:00100000:2.0:1769074930.907953:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x5c:0x0] (0->157) req@ffff91604ac91880 x1855007616179968/t4294967850(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.907963:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91880 with x1855007616179968 ext(0->157) 00002000:00010000:2.0:1769074930.907969:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac91880 00000100:00100000:3.0:1769074930.908127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.908159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.908189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.908207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.908223:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.908242:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180224 00000100:00100000:3.0:1769074930.908250:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180224 00002000:00100000:3.0:1769074930.908286:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5d:0x0] (0->157) req@ffff9161485f3b80 x1855007616180224/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.908294:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3b80 with x1855007616180224 ext(0->157) 00002000:00010000:3.0:1769074930.908298:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f3b80 00000100:00100000:0.0:1769074930.908578:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180480 00000100:00100000:0.0:1769074930.908584:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180480 00002000:00100000:0.0:1769074930.908604:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5e:0x0] (0->157) req@ffff9161485f2a00 x1855007616180480/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.908612:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2a00 with x1855007616180480 ext(0->157) 00002000:00010000:0.0:1769074930.908616:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f2a00 00000100:00100000:0.0:1769074930.908629:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180736 00000100:00100000:0.0:1769074930.908632:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180736 00002000:00100000:0.0:1769074930.908644:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5f:0x0] (0->157) req@ffff9161485f1f80 x1855007616180736/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.908651:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f1f80 with x1855007616180736 ext(0->157) 00002000:00010000:0.0:1769074930.908653:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f1f80 00000100:00100000:0.0:1769074930.908680:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180096 00000100:00100000:0.0:1769074930.908683:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180096 00002000:00100000:0.0:1769074930.908699:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x5d:0x0] (0->157) req@ffff9161485f0380 x1855007616180096/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.908705:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0380 with x1855007616180096 ext(0->157) 00002000:00010000:0.0:1769074930.908708:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f0380 00000100:00100000:0.0:1769074930.908714:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180992 00000100:00100000:0.0:1769074930.908716:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180992 00002000:00100000:0.0:1769074930.908727:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x60:0x0] (0->157) req@ffff9161485f0a80 x1855007616180992/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.908733:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0a80 with x1855007616180992 ext(0->157) 00002000:00010000:0.0:1769074930.908737:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f0a80 00000100:00100000:0.0:1769074930.908745:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 669 00000100:00100000:0.0:1769074930.908753:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+192:2420:x1855007616180480:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.909140:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 670 00000100:00100000:0.0:1769074930.909148:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+194:2420:x1855007616180736:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.909780:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 671 00000100:00100000:1.0:1769074930.909793:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+185:2419:x1855007616180096:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.910041:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 672 00000100:00100000:1.0:1769074930.910048:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+196:2420:x1855007616180992:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.910454:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 673 00000100:00100000:3.0:1769074930.910465:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+196:2420:x1855007616180224:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.910550:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910586:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910611:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.910656:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.910901:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.910911:0:8409:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:2.0:1769074930.911050:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181248 00000100:00100000:2.0:1769074930.911070:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181248 00002000:00100000:2.0:1769074930.911105:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x61:0x0] (0->157) req@ffff9161485f0700 x1855007616181248/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911113:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0700 with x1855007616181248 ext(0->157) 00002000:00010000:2.0:1769074930.911120:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f0700 00000100:00100000:2.0:1769074930.911129:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.911135:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181504 00000100:00100000:2.0:1769074930.911138:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181504 00002000:00100000:2.0:1769074930.911150:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x62:0x0] (0->157) req@ffff9161485f3800 x1855007616181504/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911157:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3800 with x1855007616181504 ext(0->157) 00002000:00010000:2.0:1769074930.911160:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f3800 00000100:00100000:2.0:1769074930.911167:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.911171:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180352 00000100:00100000:2.0:1769074930.911173:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180352 00002000:00100000:2.0:1769074930.911184:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x5e:0x0] (0->157) req@ffff9161485f1500 x1855007616180352/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911191:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f1500 with x1855007616180352 ext(0->157) 00002000:00010000:2.0:1769074930.911194:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f1500 00000100:00100000:2.0:1769074930.911199:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.911203:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180608 00000100:00100000:2.0:1769074930.911206:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180608 00002000:00100000:2.0:1769074930.911215:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x5f:0x0] (0->157) req@ffff9161485f2680 x1855007616180608/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911229:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2680 with x1855007616180608 ext(0->157) 00002000:00010000:2.0:1769074930.911233:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f2680 00000100:00100000:2.0:1769074930.911239:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.911243:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616180864 00000100:00100000:2.0:1769074930.911246:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616180864 00002000:00100000:2.0:1769074930.911256:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x60:0x0] (0->157) req@ffff9161485f3480 x1855007616180864/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911263:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3480 with x1855007616180864 ext(0->157) 00002000:00010000:2.0:1769074930.911267:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f3480 00000100:00100000:2.0:1769074930.911273:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1769074930.911278:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181120 00000100:00100000:2.0:1769074930.911280:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181120 00002000:00100000:2.0:1769074930.911291:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x61:0x0] (0->157) req@ffff9161485f0000 x1855007616181120/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.911298:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0000 with x1855007616181120 ext(0->157) 00000100:00100000:0.0:1769074930.912005:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+198:2420:x1855007616180736:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2854us (3811us total) trans 4294967852 rc 0/0 00000100:00100000:0.0:1769074930.912015:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 670 00002000:00100000:0.0:1769074930.912023:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5f:0x0] (0->157) req@ffff9161485f1f80 x1855007616180736/t4294967852(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.912030:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f1f80 with x1855007616180736 ext(0->157) 00002000:00010000:0.0:1769074930.912034:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f1f80 00000100:00100000:0.0:1769074930.912065:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181376 00000100:00100000:0.0:1769074930.912069:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181376 00002000:00100000:0.0:1769074930.912088:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x62:0x0] (0->157) req@ffff916044d26680 x1855007616181376/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.912094:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26680 with x1855007616181376 ext(0->157) 00002000:00010000:0.0:1769074930.912098:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d26680 00000100:00100000:0.0:1769074930.912106:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181632 00000100:00100000:0.0:1769074930.912108:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181632 00002000:00100000:0.0:1769074930.912122:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x63:0x0] (0->157) req@ffff916044d24a80 x1855007616181632/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.912129:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d24a80 with x1855007616181632 ext(0->157) 00002000:00010000:0.0:1769074930.912132:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d24a80 00000100:00100000:0.0:1769074930.912143:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 674 00000100:00100000:0.0:1769074930.912150:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+197:2420:x1855007616181248:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.913922:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+193:2419:x1855007616180096:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4124us (5704us total) trans 4294967862 rc 0/0 00000100:00100000:1.0:1769074930.913935:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 671 00002000:00100000:1.0:1769074930.913945:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x5d:0x0] (0->157) req@ffff9161485f0380 x1855007616180096/t4294967862(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.913954:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0380 with x1855007616180096 ext(0->157) 00002000:00010000:1.0:1769074930.913960:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f0380 00000100:00100000:1.0:1769074930.913992:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 675 00000100:00100000:1.0:1769074930.914002:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+197:2420:x1855007616181504:12345-192.168.204.32@tcp:4:cp.0 00002000:00010000:2.0:1769074930.915421:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f0000 00000100:00100000:1.0:1769074930.917190:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+203:2420:x1855007616180992:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7131us (8955us total) trans 4294967854 rc 0/0 00000100:00100000:1.0:1769074930.917203:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 672 00002000:00100000:1.0:1769074930.917214:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x60:0x0] (0->157) req@ffff9161485f0a80 x1855007616180992/t4294967854(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.917223:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0a80 with x1855007616180992 ext(0->157) 00002000:00010000:1.0:1769074930.917229:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f0a80 00000100:00100000:1.0:1769074930.917259:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 676 00000100:00100000:1.0:1769074930.917269:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+192:2419:x1855007616180352:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.917519:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+204:2420:x1855007616180480:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8765us (9357us total) trans 4294967851 rc 0/0 00000100:00100000:0.0:1769074930.917549:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 669 00002000:00100000:0.0:1769074930.917556:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5e:0x0] (0->157) req@ffff9161485f2a00 x1855007616180480/t4294967851(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.917564:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2a00 with x1855007616180480 ext(0->157) 00002000:00010000:0.0:1769074930.917568:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f2a00 00000100:00100000:0.0:1769074930.917584:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 677 00000100:00100000:0.0:1769074930.917591:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+192:2419:x1855007616180608:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.918026:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+203:2420:x1855007616181504:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4024us (7448us total) trans 4294967853 rc 0/0 00000100:00100000:2.0:1769074930.918033:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 675 00002000:00100000:2.0:1769074930.918040:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x62:0x0] (0->157) req@ffff9161485f3800 x1855007616181504/t4294967853(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.918049:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3800 with x1855007616181504 ext(0->157) 00002000:00010000:2.0:1769074930.918064:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f3800 00000100:00100000:2.0:1769074930.918082:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 678 00000100:00100000:2.0:1769074930.918089:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+192:2419:x1855007616180864:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.919225:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+202:2420:x1855007616181248:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7069us (8670us total) trans 4294967856 rc 0/0 00000100:00100000:0.0:1769074930.919236:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 674 00002000:00100000:0.0:1769074930.919244:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x61:0x0] (0->157) req@ffff9161485f0700 x1855007616181248/t4294967856(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.919253:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0700 with x1855007616181248 ext(0->157) 00002000:00010000:0.0:1769074930.919258:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f0700 00000100:00100000:0.0:1769074930.919282:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 679 00000100:00100000:0.0:1769074930.919290:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+194:2419:x1855007616181376:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.919795:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+196:2419:x1855007616180864:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1704us (9180us total) trans 4294967864 rc 0/0 00000100:00100000:2.0:1769074930.919804:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 678 00002000:00100000:2.0:1769074930.919811:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x60:0x0] (0->157) req@ffff9161485f3480 x1855007616180864/t4294967864(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.919820:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3480 with x1855007616180864 ext(0->157) 00002000:00010000:2.0:1769074930.919824:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f3480 00000100:00100000:2.0:1769074930.919840:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 680 00000100:00100000:2.0:1769074930.919847:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+195:2419:x1855007616181632:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.920883:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 681 00000100:00100000:3.0:1769074930.920894:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+197:2419:x1855007616181120:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.922027:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+201:2419:x1855007616180352:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4755us (11433us total) trans 4294967867 rc 0/0 00000100:00100000:1.0:1769074930.922038:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 676 00002000:00100000:1.0:1769074930.922047:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5e:0x0] (0->157) req@ffff9161485f1500 x1855007616180352/t4294967867(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.922066:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f1500 with x1855007616180352 ext(0->157) 00002000:00010000:1.0:1769074930.922072:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f1500 00000100:00100000:0.0:1769074930.922186:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+200:2419:x1855007616180608:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4593us (11583us total) trans 4294967863 rc 0/0 00000100:00100000:0.0:1769074930.922193:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 677 00002000:00100000:0.0:1769074930.922200:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x5f:0x0] (0->157) req@ffff9161485f2680 x1855007616180608/t4294967863(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.922209:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2680 with x1855007616180608 ext(0->157) 00002000:00010000:0.0:1769074930.922213:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f2680 00000100:00100000:0.0:1769074930.922339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.922363:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616181888 00000100:00100000:0.0:1769074930.922370:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616181888 00002000:00100000:0.0:1769074930.922400:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x67:0x0] (0->157) req@ffff916041e68a80 x1855007616181888/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.922409:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e68a80 with x1855007616181888 ext(0->157) 00002000:00010000:0.0:1769074930.922413:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041e68a80 00000100:00100000:0.0:1769074930.922430:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 682 00000100:00100000:0.0:1769074930.922437:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+200:2419:x1855007616181888:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.922773:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+201:2420:x1855007616180224:12345-192.168.204.32@tcp:4:cp.0 Request processed in 12309us (14644us total) trans 4294967855 rc 0/0 00000100:00100000:2.0:1769074930.922781:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 673 00002000:00100000:2.0:1769074930.922787:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x5d:0x0] (0->157) req@ffff9161485f3b80 x1855007616180224/t4294967855(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.922795:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3b80 with x1855007616180224 ext(0->157) 00002000:00010000:2.0:1769074930.922800:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161485f3b80 00000100:00100000:2.0:1769074930.922841:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+200:2419:x1855007616181632:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2995us (12183us total) trans 4294967865 rc 0/0 00000100:00100000:2.0:1769074930.922848:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 680 00002000:00100000:2.0:1769074930.922853:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x63:0x0] (0->157) req@ffff916044d24a80 x1855007616181632/t4294967865(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.922861:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d24a80 with x1855007616181632 ext(0->157) 00002000:00010000:2.0:1769074930.922865:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d24a80 00000100:00100000:1.0:1769074930.923106:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+199:2419:x1855007616181376:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3817us (12467us total) trans 4294967866 rc 0/0 00000100:00100000:1.0:1769074930.923113:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 679 00002000:00100000:1.0:1769074930.923119:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x62:0x0] (0->157) req@ffff916044d26680 x1855007616181376/t4294967866(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.923126:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26680 with x1855007616181376 ext(0->157) 00002000:00010000:1.0:1769074930.923129:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d26680 00000100:00100000:0.0:1769074930.923525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.923619:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+202:2419:x1855007616181120:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2726us (12993us total) trans 4294967868 rc 0/0 00000100:00100000:3.0:1769074930.923626:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 681 00002000:00100000:3.0:1769074930.923632:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x61:0x0] (0->157) req@ffff9161485f0000 x1855007616181120/t4294967868(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.923639:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f0000 with x1855007616181120 ext(0->157) 00002000:00010000:3.0:1769074930.923643:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f0000 00000100:00100000:2.0:1769074930.924112:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+201:2419:x1855007616181888:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1674us (1772us total) trans 4294967869 rc 0/0 00000100:00100000:2.0:1769074930.924119:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 682 00002000:00100000:2.0:1769074930.924126:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x67:0x0] (0->157) req@ffff916041e68a80 x1855007616181888/t4294967869(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.924133:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e68a80 with x1855007616181888 ext(0->157) 00002000:00010000:2.0:1769074930.924137:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041e68a80 00000100:00100000:3.0:1769074930.924226:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182016 00000100:00100000:3.0:1769074930.924232:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182016 00002000:00100000:3.0:1769074930.924262:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x66:0x0] (0->157) req@ffff916041e68e00 x1855007616182016/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.924270:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e68e00 with x1855007616182016 ext(0->157) 00002000:00010000:3.0:1769074930.924274:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e68e00 00000100:00100000:3.0:1769074930.924297:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 683 00000100:00100000:3.0:1769074930.924314:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+201:2420:x1855007616182016:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.925344:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+203:2420:x1855007616182016:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1035us (1815us total) trans 4294967857 rc 0/0 00000100:00100000:3.0:1769074930.925353:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 683 00002000:00100000:3.0:1769074930.925360:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x66:0x0] (0->157) req@ffff916041e68e00 x1855007616182016/t4294967857(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.925368:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e68e00 with x1855007616182016 ext(0->157) 00002000:00010000:3.0:1769074930.925379:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e68e00 00000100:00100000:0.0:1769074930.935189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935315:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182144 00000100:00100000:0.0:1769074930.935325:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182144 00002000:00100000:0.0:1769074930.935371:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x67:0x0] (0->157) req@ffff916041e6aa00 x1855007616182144/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.935382:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6aa00 with x1855007616182144 ext(0->157) 00002000:00010000:0.0:1769074930.935387:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e6aa00 00000100:00100000:0.0:1769074930.935406:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182400 00000100:00100000:0.0:1769074930.935409:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182400 00002000:00100000:0.0:1769074930.935421:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x68:0x0] (0->157) req@ffff916041e6b800 x1855007616182400/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.935428:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6b800 with x1855007616182400 ext(0->157) 00002000:00010000:0.0:1769074930.935432:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e6b800 00000100:00100000:0.0:1769074930.935441:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182656 00000100:00100000:0.0:1769074930.935444:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182656 00002000:00100000:0.0:1769074930.935457:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x68:0x0] (0->157) req@ffff916041e6ad80 x1855007616182656/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.935465:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6ad80 with x1855007616182656 ext(0->157) 00002000:00010000:0.0:1769074930.935468:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041e6ad80 00000100:00100000:0.0:1769074930.935477:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182272 00000100:00100000:0.0:1769074930.935480:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182272 00002000:00100000:0.0:1769074930.935500:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x65:0x0] (0->157) req@ffff916043583b80 x1855007616182272/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.935507:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043583b80 with x1855007616182272 ext(0->157) 00002000:00010000:0.0:1769074930.935511:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043583b80 00000100:00100000:0.0:1769074930.935524:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 684 00000100:00100000:0.0:1769074930.935566:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2420:x1855007616182144:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.935968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.935997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.936032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.936117:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182528 00000100:00100000:3.0:1769074930.936122:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182528 00002000:00100000:3.0:1769074930.936146:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x64:0x0] (0->157) req@ffff91617f8cb480 x1855007616182528/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.936154:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8cb480 with x1855007616182528 ext(0->157) 00002000:00010000:3.0:1769074930.936158:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f8cb480 00000100:00100000:3.0:1769074930.936166:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182784 00000100:00100000:3.0:1769074930.936169:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182784 00002000:00100000:3.0:1769074930.936180:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x63:0x0] (0->157) req@ffff91617f8c9f80 x1855007616182784/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.936188:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c9f80 with x1855007616182784 ext(0->157) 00002000:00010000:3.0:1769074930.936191:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f8c9f80 00000100:00100000:3.0:1769074930.936197:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616182912 00000100:00100000:3.0:1769074930.936199:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616182912 00002000:00100000:3.0:1769074930.936209:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x66:0x0] (0->157) req@ffff91617f8c9180 x1855007616182912/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.936216:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c9180 with x1855007616182912 ext(0->157) 00002000:00010000:3.0:1769074930.936219:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c9180 00000100:00100000:3.0:1769074930.936224:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183168 00000100:00100000:3.0:1769074930.936227:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183168 00002000:00100000:3.0:1769074930.936238:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x65:0x0] (0->157) req@ffff91617f8c8380 x1855007616183168/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.936245:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c8380 with x1855007616183168 ext(0->157) 00002000:00010000:3.0:1769074930.936248:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c8380 00000100:00100000:3.0:1769074930.936255:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 685 00000100:00100000:3.0:1769074930.936261:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+209:2420:x1855007616182400:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.936510:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 686 00000100:00100000:1.0:1769074930.936521:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+203:2420:x1855007616182656:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074930.936771:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 687 00000100:00100000:1.0:1769074930.936778:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2420:x1855007616182272:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.937061:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 688 00000100:00100000:2.0:1769074930.937072:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2420:x1855007616182528:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074930.937246:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 689 00000100:00100000:2.0:1769074930.937256:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616182784:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.939659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.939706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.940080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074930.940114:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183552 00000100:00100000:0.0:1769074930.940123:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183552 00000100:00100000:0.0:1769074930.940175:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9691 00000100:00100000:0.0:1769074930.940196:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+375:67735:x1855007616183552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074930.940225:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074930.940246:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf52 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9c1 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.940364:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.940380:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940390:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940403:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x9df8005c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.940409:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940414:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00000004:00080000:0.0:1769074930.940711:0:10046:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xcc:0x0], index 1: 0 00010000:00010000:0.0:1769074930.940856:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf67 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:0.0:1769074930.940866:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf67 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940872:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf67 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940904:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940911:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940917:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940923:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940929:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074930.940933:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940940:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940951:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074930.940955:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074930.940959:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940964:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febf59 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00000004:00010000:0.0:1769074930.940976:0:10046:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000061e9e600 reply state 000000000da6a834 transno 4294969120 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940985:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:0.0:1769074930.940990:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff91604f3c6b00) 00010000:00010000:0.0:1769074930.940992:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074930.940995:0:10046:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074930.941019:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf52 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c1 expref: 378 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.941031:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfbe00/0x557988ac98febf67 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c1 expref: 377 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.941037:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a1:0x0].0x0 (ffff916052b4c900) 00010000:00010000:0.0:1769074930.941040:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074930.941042:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfbe00, rc 0) 00000100:00100000:0.0:1769074930.941112:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+378:67735:x1855007616183552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 917us (1031us total) trans 4294969120 rc 0/0 00000100:00100000:0.0:1769074930.941119:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9691 00000100:00100000:1.0:1769074930.941716:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616182144:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6182us (6534us total) trans 4294967858 rc 0/0 00000100:00100000:1.0:1769074930.941726:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 684 00002000:00100000:1.0:1769074930.941736:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x67:0x0] (0->157) req@ffff916041e6aa00 x1855007616182144/t4294967858(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.941745:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6aa00 with x1855007616182144 ext(0->157) 00002000:00010000:1.0:1769074930.941751:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e6aa00 00000100:00100000:1.0:1769074930.941767:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183040 00000100:00100000:1.0:1769074930.941772:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183040 00002000:00100000:1.0:1769074930.941800:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x69:0x0] (0->157) req@ffff91617f8cb100 x1855007616183040/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074930.941809:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8cb100 with x1855007616183040 ext(0->157) 00002000:00010000:1.0:1769074930.941813:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8cb100 00000100:00100000:2.0:1769074930.941933:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2420:x1855007616182528:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4862us (5964us total) trans 4294967861 rc 0/0 00000100:00100000:2.0:1769074930.941940:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 688 00002000:00100000:2.0:1769074930.941947:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x64:0x0] (0->157) req@ffff91617f8cb480 x1855007616182528/t4294967861(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.941955:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8cb480 with x1855007616182528 ext(0->157) 00002000:00010000:2.0:1769074930.941958:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f8cb480 00000100:00100000:2.0:1769074930.941972:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183296 00000100:00100000:2.0:1769074930.941976:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183296 00002000:00100000:2.0:1769074930.941991:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x64:0x0] (0->157) req@ffff916044ce4000 x1855007616183296/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/0 e 0 to 0 dl 1769074941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.941998:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044ce4000 with x1855007616183296 ext(0->157) 00002000:00010000:2.0:1769074930.942001:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044ce4000 00000100:00100000:0.0:1769074930.942319:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+207:2420:x1855007616182656:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5799us (7053us total) trans 4294967870 rc 0/0 00000100:00100000:0.0:1769074930.942326:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 686 00002000:00100000:0.0:1769074930.942332:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x68:0x0] (0->157) req@ffff916041e6ad80 x1855007616182656/t4294967870(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.942341:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6ad80 with x1855007616182656 ext(0->157) 00002000:00010000:0.0:1769074930.942344:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041e6ad80 00000100:00100000:0.0:1769074930.942361:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 690 00000100:00100000:0.0:1769074930.942369:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2420:x1855007616182912:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.942801:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616182272:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6022us (7510us total) trans 4294967860 rc 0/0 00000100:00100000:0.0:1769074930.942809:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 687 00002000:00100000:0.0:1769074930.942815:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x65:0x0] (0->157) req@ffff916043583b80 x1855007616182272/t4294967860(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.942824:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043583b80 with x1855007616182272 ext(0->157) 00002000:00010000:0.0:1769074930.942828:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043583b80 00000100:00100000:0.0:1769074930.942843:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 691 00000100:00100000:0.0:1769074930.942850:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+208:2420:x1855007616183168:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.944408:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 692 00000100:00100000:3.0:1769074930.944426:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+210:2419:x1855007616183040:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074930.946478:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2420:x1855007616182912:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4100us (10469us total) trans 4294967871 rc 0/0 00000100:00100000:0.0:1769074930.946492:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 690 00002000:00100000:0.0:1769074930.946504:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x66:0x0] (0->157) req@ffff91617f8c9180 x1855007616182912/t4294967871(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.946514:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c9180 with x1855007616182912 ext(0->157) 00002000:00010000:0.0:1769074930.946520:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c9180 00000100:00100000:0.0:1769074930.946568:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 693 00000100:00100000:0.0:1769074930.946578:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2419:x1855007616183296:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074930.946871:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2419:x1855007616183040:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2451us (7219us total) trans 4294967873 rc 0/0 00000100:00100000:3.0:1769074930.946879:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 692 00002000:00100000:3.0:1769074930.946885:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x69:0x0] (0->157) req@ffff91617f8cb100 x1855007616183040/t4294967873(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.946894:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8cb100 with x1855007616183040 ext(0->157) 00002000:00010000:3.0:1769074930.946898:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8cb100 00000100:00100000:0.0:1769074930.947851:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2420:x1855007616183168:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4995us (11811us total) trans 4294967872 rc 0/0 00000100:00100000:0.0:1769074930.947861:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 691 00002000:00100000:0.0:1769074930.947869:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x65:0x0] (0->157) req@ffff91617f8c8380 x1855007616183168/t4294967872(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.947878:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c8380 with x1855007616183168 ext(0->157) 00002000:00010000:0.0:1769074930.947883:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c8380 00000100:00100000:3.0:1769074930.948496:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2419:x1855007616183296:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1918us (8785us total) trans 4294967874 rc 0/0 00000100:00100000:3.0:1769074930.948505:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 693 00002000:00100000:3.0:1769074930.948512:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x64:0x0] (0->157) req@ffff916044ce4000 x1855007616183296/t4294967874(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074930.948521:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044ce4000 with x1855007616183296 ext(0->157) 00002000:00010000:3.0:1769074930.948525:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044ce4000 00000100:00100000:2.0:1769074930.949255:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616182784:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11996us (13263us total) trans 4294967862 rc 0/0 00000100:00100000:2.0:1769074930.949265:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 689 00002000:00100000:2.0:1769074930.949273:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x63:0x0] (0->157) req@ffff91617f8c9f80 x1855007616182784/t4294967862(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074930.949282:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c9f80 with x1855007616182784 ext(0->157) 00002000:00010000:2.0:1769074930.949287:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f8c9f80 00000100:00100000:0.0:1769074930.949580:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2420:x1855007616182400:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13316us (14344us total) trans 4294967859 rc 0/0 00000100:00100000:0.0:1769074930.949591:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 685 00002000:00100000:0.0:1769074930.949597:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x68:0x0] (0->157) req@ffff916041e6b800 x1855007616182400/t4294967859(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:466/0 lens 648/448 e 0 to 0 dl 1769074941 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074930.949606:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e6b800 with x1855007616182400 ext(0->157) 00002000:00010000:0.0:1769074930.949610:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e6b800 00000100:00100000:2.0:1769074930.957336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.958271:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183680 00000100:00100000:3.0:1769074930.958283:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183680 00000100:00100000:3.0:1769074930.958489:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2807 00000100:00100000:3.0:1769074930.958500:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2418:x1855007616183680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074930.958519:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074930.958565:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9c8 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074930.958589:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074930.958608:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.958610:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074930.958619:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 212 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.958636:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 212 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074930.958649:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074930.959124:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2418:x1855007616183680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 624us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074930.959133:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2807 00000100:00100000:1.0:1769074930.969739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074930.969841:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183808 00000100:00100000:2.0:1769074930.969857:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183808 00000100:00100000:2.0:1769074930.969924:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2808 00000100:00100000:2.0:1769074930.969934:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:67735:x1855007616183808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074930.969953:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074930.969971:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9cf expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.970004:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 213 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.970012:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.970014:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074930.970018:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9cf expref: 213 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.970060:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 213 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074930.970081:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 213 pid: 8405 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074930.970095:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626636928:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074930.970192:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074930.973856:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626636928:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074930.973856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1769074930.973888:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9cf expref: 213 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074930.973906:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280600, rc 0) 00000100:00100000:0.0:1769074930.974049:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616183936 00000100:00100000:0.0:1769074930.974070:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616183936 00010000:00010000:0.0:1769074930.974120:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 214 pid: 8405 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074930.974160:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1931 00000100:00100000:0.0:1769074930.974169:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616183936:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074930.974182:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074930.974201:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 214 pid: 8405 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074930.974212:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 214 pid: 8405 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074930.974240:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98febf75 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9c8 expref: 214 pid: 8405 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074930.974253:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.974255:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074930.974262:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9cf expref: 213 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.974273:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9cf expref: 213 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074930.974319:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e280600/0x557988ac98febf7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9cf expref: 213 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074930.974333:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626637056:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074930.974420:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614bb21540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074930.975130:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:67735:x1855007616183808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5194us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.975140:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2808 00000100:00100000:0.0:1769074930.981829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074930.982566:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184192 00000100:00100000:3.0:1769074930.982576:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184192 00000100:00100000:3.0:1769074930.982629:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1916 00000100:00100000:3.0:1769074930.982639:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+378:67735:x1855007616184192:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074930.982990:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67735:x1855007616184192:12345-192.168.204.32@tcp:35:cp.0 Request processed in 351us (1169us total) trans 4294969121 rc 0/0 00000100:00100000:3.0:1769074930.982999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1916 00000100:00100000:2.0:1769074930.983622:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626637056:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074930.983647:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074930.983749:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2420:x1855007616183936:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9580us (9901us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074930.983757:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1931 00000100:00100000:3.0:1769074931.014572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.015105:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184320 00000100:00100000:1.0:1769074931.015119:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184320 00000100:00100000:1.0:1769074931.015203:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 249 00000100:00100000:1.0:1769074931.015213:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:2419:x1855007616184320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074931.015251:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.015271:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febf83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9d6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.015336:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074931.015351:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015361:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015374:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074931.015381:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015387:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015453:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015460:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015466:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015471:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.015475:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015483:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015510:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.015514:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.015519:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015524:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febf8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015574:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015582:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015587:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015592:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.015595:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015601:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015608:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604f4f9600) 00010000:00010000:1.0:1769074931.015610:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.015613:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015619:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febf91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074931.015648:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febf83 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9d6 expref: 380 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.015659:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.015870:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074931.015876:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febf83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9d6 expref: 380 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.015886:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc -2) 00000100:00100000:1.0:1769074931.016039:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:2419:x1855007616184320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 827us (1511us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074931.016047:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 249 00000100:00080000:3.0:1769074931.017982:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074931.039080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.039804:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184448 00000100:00100000:0.0:1769074931.039816:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184448 00000100:00100000:0.0:1769074931.039893:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9692 00000100:00100000:0.0:1769074931.039903:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67738:x1855007616184448:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074931.039931:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.039953:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98febf98 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9dd expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.040016:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.040030:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040042:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040068:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.040076:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040082:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040134:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040142:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040149:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040155:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.040159:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040167:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040179:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.040182:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.040186:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040193:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febf9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040206:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040223:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040230:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040235:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.040237:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040243:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040250:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604e0d3000) 00010000:00010000:0.0:1769074931.040253:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.040255:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040261:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfa6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.040290:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98febf98 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9dd expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.040377:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.040380:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.040385:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98febf98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9dd expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.040395:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074931.040465:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67738:x1855007616184448:12345-192.168.204.32@tcp:101:bash.0 Request processed in 563us (1394us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.040471:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9692 00000100:00080000:3.0:1769074931.040836:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1769074931.056271:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.056441:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184576 00000100:00100000:1.0:1769074931.056451:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184576 00000100:00100000:1.0:1769074931.056516:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9693 00000100:00100000:1.0:1769074931.056526:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67739:x1855007616184576:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.056588:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.056611:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9e4 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.056690:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074931.056704:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056715:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056728:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074931.056735:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056740:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056792:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056798:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056804:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056810:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056815:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.056819:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056825:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056837:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.056840:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.056845:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056850:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056863:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056869:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056874:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056879:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.056881:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056886:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056893:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604f4f9600) 00010000:00010000:1.0:1769074931.056895:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.056897:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056903:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.056931:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9e4 expref: 380 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.056940:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.056942:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.056945:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9e4 expref: 380 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.056954:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074931.057008:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67739:x1855007616184576:12345-192.168.204.32@tcp:101:rm.0 Request processed in 484us (746us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.057016:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9693 00000100:00100000:2.0:1769074931.067704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.067751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.067841:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184832 00000100:00100000:1.0:1769074931.067851:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184832 00000100:00100000:1.0:1769074931.067908:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 250 00000100:00100000:1.0:1769074931.067925:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:2420:x1855007616184832:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074931.067962:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.067983:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfc2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9f2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.068036:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074931.068059:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068071:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068085:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074931.068092:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068097:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068146:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068153:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068163:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068168:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.068172:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068181:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068192:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.068195:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.068199:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068204:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febfc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068216:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068221:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068226:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068231:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.068233:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068239:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068250:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604f4f9600) 00010000:00010000:1.0:1769074931.068252:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.068254:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068259:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febfd0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.068284:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfc2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9f2 expref: 380 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.068294:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.068296:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074931.068299:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9f2 expref: 380 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.068308:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc -2) 00000100:00100000:1.0:1769074931.068378:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:2420:x1855007616184832:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 461us (625us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074931.068386:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 250 00000100:00100000:0.0:1769074931.068585:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184704 00000100:00100000:0.0:1769074931.068591:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184704 00000100:00100000:0.0:1769074931.068626:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9694 00000100:00100000:0.0:1769074931.068633:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67739:x1855007616184704:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074931.068642:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.068652:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9eb expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.068686:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.068696:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068702:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068714:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.068721:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068727:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068751:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068757:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068762:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068767:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.068769:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068775:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068783:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.068785:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.068788:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068794:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98febfde lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068803:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068808:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068812:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068816:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.068819:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068824:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068830:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604e0d3000) 00010000:00010000:0.0:1769074931.068832:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.068835:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068839:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98febfe5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.068860:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfd7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9eb expref: 380 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.068869:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.068871:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.068874:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98febfd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9eb expref: 380 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.068882:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074931.068922:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67739:x1855007616184704:12345-192.168.204.32@tcp:101:rm.0 Request processed in 279us (1219us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.068928:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9694 00000100:00100000:2.0:1769074931.091469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.091598:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616184960 00000100:00100000:1.0:1769074931.091609:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616184960 00000100:00100000:1.0:1769074931.091676:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9695 00000100:00100000:1.0:1769074931.091685:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67740:x1855007616184960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.091708:0:10046:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.091733:0:10046:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2b9f9 expref: -99 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.091805:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074931.091821:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091832:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091846:0:10046:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10046 initiator: MDT0 00010000:00010000:1.0:1769074931.091852:0:10046:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091858:0:10046:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091926:0:10046:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091933:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091939:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091945:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091950:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.091954:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091965:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091976:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.091979:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.091984:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.091990:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98febff3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092004:0:10046:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092010:0:10046:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092015:0:10046:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092019:0:10046:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.092021:0:10046:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092026:0:10046:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092032:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604f4f9600) 00010000:00010000:1.0:1769074931.092034:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.092036:0:10046:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092041:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98febffa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:1.0:1769074931.092081:0:10046:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9f9 expref: 380 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.092090:0:10046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.092093:0:10046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.092096:0:10046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98febfec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2b9f9 expref: 380 pid: 10046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.092106:0:10046:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074931.092177:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67740:x1855007616184960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 492us (718us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.092185:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9695 00000100:00100000:3.0:1769074931.103455:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.103675:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185088 00000100:00100000:0.0:1769074931.103685:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185088 00000100:00100000:0.0:1769074931.103743:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9696 00000100:00100000:0.0:1769074931.103753:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67740:x1855007616185088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.103773:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.103794:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec001 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba00 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.103862:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.103877:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103888:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103904:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.103918:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103925:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103972:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103980:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103986:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.103991:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.103994:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104001:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104013:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.104015:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.104019:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104024:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec008 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104037:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104042:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104047:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104061:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.104064:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104070:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104077:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604e0d3000) 00010000:00010000:0.0:1769074931.104080:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.104083:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104088:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec00f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.104117:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec001 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba00 expref: 380 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.104127:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.104129:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.104133:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec001 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba00 expref: 380 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.104146:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec800, rc 0) 00000100:00100000:0.0:1769074931.104738:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67740:x1855007616185088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 984us (1289us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.104748:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9696 00000100:00100000:2.0:1769074931.118983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.119185:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185344 00000100:00100000:0.0:1769074931.119208:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185344 00000100:00100000:0.0:1769074931.119272:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9697 00000100:00100000:0.0:1769074931.119282:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+379:67740:x1855007616185344:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.119302:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.119322:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec016 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba07 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.119442:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.119457:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.119468:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.119482:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xaa650385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.119488:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.119510:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:0.0:1769074931.119905:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xcc:0x0], index 0: 0 00010000:00010000:0.0:1769074931.120069:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec02b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.120079:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec02b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120085:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec02b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120117:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120124:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120129:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120135:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.120139:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120145:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120156:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.120159:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.120164:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120169:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec01d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:0.0:1769074931.120186:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000515f5afe reply state 00000000baac2fc9 transno 4294969122 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120195:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.120201:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604e0d3000) 00010000:00010000:0.0:1769074931.120203:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074931.120205:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074931.120237:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec016 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba07 expref: 382 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.120250:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec600/0x557988ac98fec02b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba07 expref: 381 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.120257:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a2:0x0].0x0 (ffff91604e0d3500) 00010000:00010000:0.0:1769074931.120259:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074931.120261:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d0ec600, rc 0) 00000100:00100000:0.0:1769074931.120332:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+382:67740:x1855007616185344:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1051us (1359us total) trans 4294969122 rc 0/0 00000100:00100000:0.0:1769074931.120341:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9697 00000100:00100000:3.0:1769074931.123901:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626637184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1769074931.123994:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074931.124086:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637184 00000100:00100000:3.0:1769074931.124095:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637184 00000100:00100000:3.0:1769074931.124138:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1769074931.124146:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626637184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1769074931.124181:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:3.0:1769074931.124764:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626637184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 616us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074931.124773:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1769074931.124828:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626637184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769074931.125032:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1855007626637440:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125080:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125110:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1855007626637952:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125133:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125150:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626638464:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125172:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125188:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1769074931.125193:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626637312:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125231:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125254:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626637824:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125273:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125289:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626638336:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125331:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637312 00000100:00100000:1.0:1769074931.125336:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637312 00000100:00100000:1.0:1769074931.125367:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1769074931.125374:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604361ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626637312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125413:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604361ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626637312:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.125419:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1769074931.125447:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638464 00000100:00100000:1.0:1769074931.125451:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638464 00000100:00100000:1.0:1769074931.125477:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637824 00000100:00100000:1.0:1769074931.125480:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637824 00000100:00100000:1.0:1769074931.125500:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1769074931.125506:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626638464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125566:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626638464:12345-0@lo:400:kworker.0 Request processed in 61us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.125573:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1769074931.125585:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1769074931.125590:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626637824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125614:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626637824:12345-0@lo:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.125619:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1769074931.125651:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1855007626637696:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125687:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125702:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626638208:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125720:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125732:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1855007626638720:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125779:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125797:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1769074931.125803:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1855007626637568:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125821:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125837:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1855007626638080:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125866:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626638592:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.125883:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.125905:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637440 00000100:00100000:1.0:1769074931.125908:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637440 00000100:00100000:1.0:1769074931.125930:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637952 00000100:00100000:1.0:1769074931.125933:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637952 00000100:00100000:1.0:1769074931.125945:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637696 00000100:00100000:1.0:1769074931.125947:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637696 00000100:00100000:1.0:1769074931.125958:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638720 00000100:00100000:1.0:1769074931.125961:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638720 00000100:00100000:1.0:1769074931.125969:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626637568 00000100:00100000:1.0:1769074931.125971:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626637568 00000100:00100000:1.0:1769074931.125983:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638080 00000100:00100000:1.0:1769074931.125985:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638080 00000100:00100000:1.0:1769074931.125998:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1769074931.126004:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1855007626637440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126032:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1855007626637440:12345-0@lo:400:kworker.0 Request processed in 28us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126038:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1769074931.126060:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1769074931.126067:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1855007626637952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126092:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1855007626637952:12345-0@lo:400:kworker.0 Request processed in 26us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126098:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1769074931.126109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:1.0:1769074931.126114:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1855007626637696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126142:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1855007626637696:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126147:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:1.0:1769074931.126157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:1.0:1769074931.126163:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1855007626638720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126185:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1855007626638720:12345-0@lo:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:1.0:1769074931.126199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1769074931.126205:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1855007626637568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126227:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1855007626637568:12345-0@lo:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126232:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1769074931.126243:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1769074931.126249:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1855007626638080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126273:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1855007626638080:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126279:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1769074931.126298:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638208 00000100:00100000:1.0:1769074931.126301:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638208 00000100:00100000:1.0:1769074931.126319:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638592 00000100:00100000:1.0:1769074931.126322:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638592 00000100:00100000:1.0:1769074931.126339:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1769074931.126344:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626638208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126372:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626638208:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126378:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1769074931.126388:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1769074931.126393:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626638592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126417:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626638592:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.126422:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1769074931.126454:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626637312:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126464:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967844 gen 2 00000100:00100000:1.0:1769074931.126478:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626637824:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126488:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1855007626637440:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126498:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1855007626637952:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126507:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626638464:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126564:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1855007626637568:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126573:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1855007626638080:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126581:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626638592:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126589:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1855007626637696:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126595:0:3657:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967855 gen 2 00000100:00100000:1.0:1769074931.126604:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626638208:0@lo:400:kworker.0 00000100:00100000:1.0:1769074931.126612:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1855007626638720:0@lo:400:kworker.0 00000100:00100000:3.0:1769074931.127083:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638336 00000100:00100000:3.0:1769074931.127089:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638336 00000100:00100000:3.0:1769074931.127133:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1769074931.127141:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626638336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074931.127193:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626638336:12345-0@lo:400:kworker.0 Request processed in 53us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074931.127198:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:3.0:1769074931.127299:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1769074931.127304:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1769074931.127306:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1769074931.127309:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074931.127338:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626638336:0@lo:400:kworker.0 00000100:00100000:3.0:1769074931.127591:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626638848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074931.127628:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074931.132850:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1769074931.132871:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626638976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1769074931.132949:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074931.132996:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638976 00000100:00100000:3.0:1769074931.133003:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638976 00000100:00100000:3.0:1769074931.133045:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1769074931.133064:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626638976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1769074931.133094:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446215680 avail 1299976192 00000100:00100000:3.0:1769074931.133135:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626638976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074931.133144:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1769074931.133183:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626638976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1769074931.137847:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.137940:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185472 00000100:00100000:3.0:1769074931.137950:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185472 00000100:00100000:3.0:1769074931.138025:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2809 00000100:00100000:3.0:1769074931.138035:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2419:x1855007616185472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074931.138079:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.138098:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba0e expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074931.138123:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074931.138141:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.138143:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.138151:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 214 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074931.138168:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 214 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074931.138180:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc 0) 00000100:00100000:3.0:1769074931.138378:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2419:x1855007616185472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 343us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074931.138386:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2809 00000100:00080000:2.0:1769074931.139142:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769074931.142359:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626638848 00000100:00100000:0.0:1769074931.142373:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626638848 00000100:00100000:0.0:1769074931.142492:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1769074931.142502:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626638848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1769074931.142543:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2981888 granted 493280192 pending 430080 free 3915644928 avail 3684122624 00000100:00100000:0.0:1769074931.142631:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626638848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (15002us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.142643:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1769074931.142738:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626638848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074931.144583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.145220:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185600 00000100:00100000:2.0:1769074931.145231:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185600 00000100:00100000:2.0:1769074931.145288:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2810 00000100:00100000:2.0:1769074931.145298:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:67740:x1855007616185600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.145314:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.145332:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba15 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.145362:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.145370:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.145373:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.145377:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba15 expref: 215 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.145410:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.145424:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074931.145436:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626639104:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074931.145867:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074931.150961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.151638:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626639104:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074931.151683:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba15 expref: 215 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.151703:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281600, rc 0) 00000100:00100000:0.0:1769074931.151771:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:67740:x1855007616185600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6474us (7193us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.151779:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2810 00000100:00100000:3.0:1769074931.151980:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185728 00000100:00100000:3.0:1769074931.151987:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185728 00010000:00010000:3.0:1769074931.152031:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:3.0:1769074931.152073:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1932 00000100:00100000:3.0:1769074931.152081:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616185728:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074931.152094:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074931.152114:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:3.0:1769074931.152127:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:3.0:1769074931.152149:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec039 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba0e expref: 215 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:3.0:1769074931.152161:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.152163:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.152169:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba15 expref: 214 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.152178:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba15 expref: 214 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.152221:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e281600/0x557988ac98fec040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba15 expref: 214 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074931.152240:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044d25c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626639232:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074931.152296:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617bb8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074931.157310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.157607:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616185984 00000100:00100000:1.0:1769074931.157617:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616185984 00000100:00100000:1.0:1769074931.157677:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1917 00000100:00100000:1.0:1769074931.157686:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+382:67740:x1855007616185984:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074931.157989:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67740:x1855007616185984:12345-192.168.204.32@tcp:35:cp.0 Request processed in 302us (687us total) trans 4294969123 rc 0/0 00000100:00100000:1.0:1769074931.157996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1917 00000100:00100000:0.0:1769074931.164107:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044d25c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626639232:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074931.164137:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074931.164281:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616185728:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12199us (13327us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.164293:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1932 00000100:00100000:3.0:1769074931.208331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.208447:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186112 00000100:00100000:2.0:1769074931.208456:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186112 00000100:00100000:2.0:1769074931.208566:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9698 00000100:00100000:2.0:1769074931.208578:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67743:x1855007616186112:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074931.208600:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.208623:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec047 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba1c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.208700:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074931.208713:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208723:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208735:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074931.208741:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208747:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208799:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208805:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208810:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208816:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208825:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.208829:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208836:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208847:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.208850:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.208855:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208860:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec04e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208873:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208879:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208883:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208888:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.208890:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208895:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.208900:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91618163cc00) 00010000:00010000:2.0:1769074931.208902:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.208905:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.209122:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec055 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.209158:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec047 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba1c expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.209168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.209170:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.209174:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec047 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba1c expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.209181:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074931.209280:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67743:x1855007616186112:12345-192.168.204.32@tcp:101:bash.0 Request processed in 704us (958us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.209287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9698 00000100:00100000:2.0:1769074931.222935:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.223123:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186240 00000100:00100000:0.0:1769074931.223134:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186240 00000100:00100000:0.0:1769074931.223225:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9699 00000100:00100000:0.0:1769074931.223235:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67744:x1855007616186240:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074931.223263:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.223283:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec05c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.223351:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.223366:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223378:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223416:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.223423:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223430:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223483:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223491:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223497:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223503:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223509:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.223513:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223519:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223569:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.223573:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.223579:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223585:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fec063 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223598:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223603:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223609:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223614:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.223617:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223623:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074931.223632:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.223635:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec06a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.223669:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec05c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba23 expref: 384 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.223679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.223682:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.223685:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fec05c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba23 expref: 384 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.223693:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfac00, rc 0) 00000100:00100000:0.0:1769074931.223743:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67744:x1855007616186240:12345-192.168.204.32@tcp:101:rm.0 Request processed in 509us (818us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.223751:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9699 00000100:00100000:2.0:1769074931.229610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.229640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.229883:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186368 00000100:00100000:3.0:1769074931.229894:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186368 00000100:00100000:3.0:1769074931.229966:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 254 00000100:00100000:3.0:1769074931.229976:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:2418:x1855007616186368:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074931.230035:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.230063:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec071 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba2a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.230122:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074931.230135:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230146:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230160:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074931.230167:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230173:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230244:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230252:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230258:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230263:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.230268:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230274:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230287:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.230290:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.230294:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230299:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec078 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230311:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230316:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230321:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230326:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.230329:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230334:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230341:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff916052a4fb00) 00010000:00010000:3.0:1769074931.230343:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.230346:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230350:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec07f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074931.230374:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec071 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba2a expref: 384 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.230384:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.230386:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074931.230390:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec071 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba2a expref: 384 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.230398:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc -2) 00000100:00100000:3.0:1769074931.230466:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:2418:x1855007616186368:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 491us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074931.230474:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 254 00000100:00100000:0.0:1769074931.231422:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186496 00000100:00100000:0.0:1769074931.231431:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186496 00000100:00100000:0.0:1769074931.231483:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9700 00000100:00100000:0.0:1769074931.231491:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67744:x1855007616186496:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074931.231504:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.231519:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec086 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba62 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.231599:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.231611:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231621:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231634:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.231640:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231645:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231691:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231698:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231704:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231709:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.231713:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231719:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231728:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.231731:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.231735:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231741:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec08d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231750:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231754:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231760:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231765:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.231769:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231774:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231780:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074931.231782:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.231785:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231789:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec094 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.231814:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec086 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba62 expref: 384 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.231822:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.231825:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.231828:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec086 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba62 expref: 384 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.231834:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074931.231883:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67744:x1855007616186496:12345-192.168.204.32@tcp:101:rm.0 Request processed in 393us (2242us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.231890:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9700 00000100:00100000:1.0:1769074931.254771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.254867:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186624 00000100:00100000:2.0:1769074931.254878:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186624 00000100:00100000:2.0:1769074931.254936:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9701 00000100:00100000:2.0:1769074931.254945:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67747:x1855007616186624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.254965:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.254985:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec09b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba69 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.255080:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074931.255096:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255106:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255120:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074931.255127:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255133:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255181:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255187:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255193:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255198:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255203:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.255218:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255226:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255241:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.255244:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.255248:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255254:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec0a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255268:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255273:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255278:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255282:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f499800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.255285:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255289:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255296:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91618163cc00) 00010000:00010000:2.0:1769074931.255298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.255301:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255306:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499800/0x557988ac98fec0a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074931.255334:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec09b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba69 expref: 384 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.255343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.255346:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.255349:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec09b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba69 expref: 384 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.255358:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc 0) 00000100:00100000:2.0:1769074931.255418:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67747:x1855007616186624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 473us (657us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.255425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9701 00000100:00100000:3.0:1769074931.259360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.259473:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186752 00000100:00100000:1.0:1769074931.259486:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186752 00000100:00100000:1.0:1769074931.259600:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 255 00000100:00100000:1.0:1769074931.259609:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:2419:x1855007616186752:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074931.259680:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.259701:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec0b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ba70 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.259756:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074931.259771:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259781:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259796:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074931.259808:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259814:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259872:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259879:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259885:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259891:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.259894:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259901:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259913:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.259916:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.259920:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259926:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec0b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259938:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259943:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259949:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259953:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.259955:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259961:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259967:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91604f4f9c00) 00010000:00010000:1.0:1769074931.259969:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.259972:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.259978:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec0be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074931.260006:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec0b0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba70 expref: 384 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.260015:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.260017:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074931.260020:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec0b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ba70 expref: 384 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.260028:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc -2) 00000100:00100000:1.0:1769074931.260098:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:2419:x1855007616186752:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 489us (748us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074931.260106:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 255 00000100:00100000:3.0:1769074931.265656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.265763:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616186880 00000100:00100000:0.0:1769074931.265773:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616186880 00000100:00100000:0.0:1769074931.265838:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9702 00000100:00100000:0.0:1769074931.265850:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67747:x1855007616186880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.265874:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.265896:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2baa8 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.265966:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.265981:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.265992:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266008:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.266014:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266019:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266089:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266096:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266102:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266108:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.266111:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266122:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266133:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.266136:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.266140:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266146:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266160:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266166:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266172:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266178:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.266181:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266186:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266193:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074931.266195:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.266198:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266203:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.266244:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0c5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2baa8 expref: 384 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.266254:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.266256:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.266260:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2baa8 expref: 384 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.266269:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074931.266335:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67747:x1855007616186880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 485us (687us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.266343:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9702 00000100:00100000:2.0:1769074931.271260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.271339:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187136 00000100:00100000:0.0:1769074931.271350:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187136 00000100:00100000:0.0:1769074931.271408:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9703 00000100:00100000:0.0:1769074931.271417:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+383:67747:x1855007616187136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.271439:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.271458:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0da lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2baaf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.271606:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.271622:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.271633:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.271653:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.271671:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.271678:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074931.271989:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xcd:0x0], index 1: 0 00010000:00010000:0.0:1769074931.272150:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4faa00/0x557988ac98fec0ef lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.272159:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4faa00/0x557988ac98fec0ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272166:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4faa00/0x557988ac98fec0ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272201:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272209:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272214:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272219:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272225:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.272230:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272237:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272249:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.272252:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.272257:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272263:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec0e1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074931.272276:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2c05f91 reply state 000000003588e033 transno 4294969124 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272287:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.272293:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074931.272295:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074931.272298:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074931.272325:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0da lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2baaf expref: 386 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.272338:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4faa00/0x557988ac98fec0ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2baaf expref: 385 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.272346:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a3:0x0].0x0 (ffff91604e0d3400) 00010000:00010000:0.0:1769074931.272348:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074931.272351:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4faa00, rc 0) 00000100:00100000:0.0:1769074931.272420:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+386:67747:x1855007616187136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1004us (1170us total) trans 4294969124 rc 0/0 00000100:00100000:0.0:1769074931.272432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9703 00000100:00100000:3.0:1769074931.279356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.279462:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187264 00000100:00100000:0.0:1769074931.279472:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187264 00000100:00100000:0.0:1769074931.279589:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2811 00000100:00100000:0.0:1769074931.279600:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2420:x1855007616187264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.279617:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.279636:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bab6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074931.279670:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074931.279687:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.279690:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.279699:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 213 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074931.279716:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 213 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074931.279729:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074931.279780:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2420:x1855007616187264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 182us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.279788:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2811 00000100:00080000:2.0:1769074931.279929:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1769074931.283724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.283836:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187392 00000100:00100000:2.0:1769074931.283848:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187392 00000100:00100000:2.0:1769074931.283908:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2812 00000100:00100000:2.0:1769074931.283917:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:67747:x1855007616187392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.283935:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.283954:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2babd expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.283983:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 214 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.283992:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.283994:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.283999:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2babd expref: 214 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.284037:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 214 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.284058:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 214 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074931.284072:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626639360:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074931.284175:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074931.287759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.287856:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187520 00000100:00100000:0.0:1769074931.287868:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187520 00010000:00010000:0.0:1769074931.287937:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 215 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074931.287992:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1933 00000100:00100000:0.0:1769074931.288002:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616187520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074931.288019:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074931.288043:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 215 pid: 25313 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.288067:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 215 pid: 25313 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.288097:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.288100:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.288109:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2babd expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.288120:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2babd expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.288160:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2babd expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074931.288173:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626639488:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074931.288297:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ac83300 going to sleep for 11 seconds 00010000:00010000:2.0:1769074931.289169:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb600/0x557988ac98fec0fd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bab6 expref: 215 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074931.289187:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626639360:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074931.289217:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f499800/0x557988ac98fec104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2babd expref: 214 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.289228:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499800, rc 0) 00000100:00100000:2.0:1769074931.289273:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:67747:x1855007616187392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5357us (5559us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.289281:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2812 00000100:00100000:0.0:1769074931.293480:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626639488:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074931.293522:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074931.293630:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2419:x1855007616187520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5627us (5880us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.293641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1933 00000100:00100000:3.0:1769074931.297299:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.297408:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187776 00000100:00100000:2.0:1769074931.297419:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187776 00000100:00100000:2.0:1769074931.297480:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1918 00000100:00100000:2.0:1769074931.297490:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+386:67747:x1855007616187776:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074931.297849:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67747:x1855007616187776:12345-192.168.204.32@tcp:35:cp.0 Request processed in 359us (557us total) trans 4294969125 rc 0/0 00000100:00100000:2.0:1769074931.297857:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1918 00000100:00100000:3.0:1769074931.329109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.330427:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616187904 00000100:00100000:2.0:1769074931.330442:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616187904 00000100:00100000:2.0:1769074931.330518:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 256 00000100:00100000:2.0:1769074931.330568:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:2420:x1855007616187904:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074931.330638:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.330671:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec10b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bac4 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.330726:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.330741:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330750:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330764:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.330770:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330775:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330827:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330834:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330841:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330846:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.330849:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330855:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330865:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.330868:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.330874:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330879:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec112 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330892:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330897:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330901:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330906:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.330909:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330915:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330926:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91618163cc00) 00010000:00010000:2.0:1769074931.330928:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.330931:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330935:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec119 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.330963:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec10b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bac4 expref: 388 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.330971:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.330973:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074931.330976:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec10b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bac4 expref: 388 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.330985:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc -2) 00000100:00100000:2.0:1769074931.333396:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:2420:x1855007616187904:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2857us (4285us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074931.333410:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 256 00000100:00100000:3.0:1769074931.357640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.358174:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188032 00000100:00100000:2.0:1769074931.358187:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188032 00000100:00100000:2.0:1769074931.358391:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9704 00000100:00100000:2.0:1769074931.358402:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67755:x1855007616188032:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074931.358423:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.358446:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec120 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bafc expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.358609:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.358625:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358635:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358648:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.358654:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358782:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358832:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358839:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358845:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358850:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.358854:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358860:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358875:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.358878:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.358882:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358888:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec127 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358900:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358905:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358910:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358916:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.358918:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358923:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358929:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91618163cc00) 00010000:00010000:2.0:1769074931.358931:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.358934:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358938:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec12e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.358967:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec120 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bafc expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.358976:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.358979:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.358982:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec120 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bafc expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.358990:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc 0) 00000100:00100000:2.0:1769074931.359127:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67755:x1855007616188032:12345-192.168.204.32@tcp:101:bash.0 Request processed in 727us (1496us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.359134:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9704 00000100:00100000:3.0:1769074931.373520:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.373599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.373696:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188160 00000100:00100000:2.0:1769074931.373707:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188160 00000100:00100000:2.0:1769074931.373771:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9705 00000100:00100000:2.0:1769074931.373781:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67756:x1855007616188160:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074931.373803:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.373826:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec135 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb03 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.373895:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.373910:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.373920:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.373934:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.373945:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.373950:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374004:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374010:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374016:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374022:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.374025:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374033:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374043:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.374056:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.374061:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374066:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec13c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374081:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374087:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374093:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374098:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.374101:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374106:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374113:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91618163cc00) 00010000:00010000:2.0:1769074931.374115:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.374117:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374122:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec143 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.374151:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec135 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb03 expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.374160:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.374163:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.374167:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec135 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb03 expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.374176:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc 0) 00000100:00100000:2.0:1769074931.374238:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67756:x1855007616188160:12345-192.168.204.32@tcp:101:rm.0 Request processed in 459us (727us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.374246:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9705 00000100:00100000:0.0:1769074931.374608:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188288 00000100:00100000:0.0:1769074931.374615:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188288 00000100:00100000:0.0:1769074931.374664:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 257 00000100:00100000:0.0:1769074931.374672:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:2420:x1855007616188288:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074931.374695:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.374707:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec14a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb0a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.374739:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074931.374749:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374756:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374794:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074931.374801:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374806:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374840:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374845:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374852:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374857:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.374860:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374866:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374875:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.374878:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.374881:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374885:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec151 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374895:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374901:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374906:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374911:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.374914:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374919:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374930:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604e0d3900) 00010000:00010000:0.0:1769074931.374932:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.374935:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374940:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec158 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074931.374960:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec14a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb0a expref: 388 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.374968:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.374970:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074931.374974:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec14a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb0a expref: 388 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.374980:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa400, rc -2) 00000100:00100000:0.0:1769074931.375027:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:2420:x1855007616188288:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 355us (1426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074931.375034:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 257 00000100:00100000:3.0:1769074931.379727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.379932:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188416 00000100:00100000:1.0:1769074931.379944:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188416 00000100:00100000:1.0:1769074931.380001:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9706 00000100:00100000:1.0:1769074931.380011:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67756:x1855007616188416:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.380032:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.380063:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec15f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb11 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.380137:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.380153:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380164:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380179:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.380186:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380192:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380259:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380266:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380272:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380279:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380284:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.380288:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380295:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380306:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.380309:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.380314:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec166 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380332:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380338:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380343:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380347:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.380350:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380355:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380366:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91604f4f9c00) 00010000:00010000:1.0:1769074931.380369:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.380371:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380377:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec16d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.380406:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec15f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb11 expref: 388 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.380416:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.380418:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.380422:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec15f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb11 expref: 388 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.380431:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074931.380496:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67756:x1855007616188416:12345-192.168.204.32@tcp:101:rm.0 Request processed in 486us (779us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.380503:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9706 00000100:00100000:3.0:1769074931.403648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.403807:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188544 00000100:00100000:0.0:1769074931.403820:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188544 00000100:00100000:0.0:1769074931.403889:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9707 00000100:00100000:0.0:1769074931.403899:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67757:x1855007616188544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.403919:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.403941:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec174 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb18 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.404016:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.404031:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404042:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404069:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.404077:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404083:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404143:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404150:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404157:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404162:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.404166:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404173:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404189:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.404192:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.404196:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404202:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec17b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404363:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404370:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404376:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404381:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.404383:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404389:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404396:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91604e0d3900) 00010000:00010000:0.0:1769074931.404399:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.404402:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404406:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec182 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.404437:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec174 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb18 expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.404447:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.404450:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.404453:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec174 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb18 expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.404461:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa400, rc 0) 00000100:00100000:0.0:1769074931.404718:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67757:x1855007616188544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 818us (1079us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.404727:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9707 00000100:00100000:3.0:1769074931.408729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.408837:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188672 00000100:00100000:0.0:1769074931.408848:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188672 00000100:00100000:0.0:1769074931.408896:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9708 00000100:00100000:0.0:1769074931.408905:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67757:x1855007616188672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.408926:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.408945:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa800/0x557988ac98fec189 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb1f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.409009:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.409023:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409035:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409080:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.409093:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409100:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409154:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409162:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409169:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409175:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.409179:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409186:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409197:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.409200:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.409214:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409221:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec190 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409236:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409242:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409249:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409254:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.409257:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409263:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409270:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff916052ae5c00) 00010000:00010000:0.0:1769074931.409273:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.409275:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409281:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec197 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.409308:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa800/0x557988ac98fec189 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb1f expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.409318:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.409321:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.409324:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa800/0x557988ac98fec189 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb1f expref: 388 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.409333:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa800, rc 0) 00000100:00100000:0.0:1769074931.409394:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67757:x1855007616188672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 490us (673us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.409402:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9708 00000100:00100000:3.0:1769074931.415219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.415317:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616188928 00000100:00100000:1.0:1769074931.415328:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616188928 00000100:00100000:1.0:1769074931.415389:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9709 00000100:00100000:1.0:1769074931.415399:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67757:x1855007616188928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.415420:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.415441:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec19e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.415601:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.415616:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.415628:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.415643:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.415650:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.415667:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074931.415956:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xcd:0x0], index 0: 0 00010000:00010000:1.0:1769074931.416109:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98fec1b3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.416119:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98fec1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416126:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98fec1b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416156:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416163:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416174:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416180:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416186:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.416190:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416198:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416209:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.416213:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.416217:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416223:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec1a5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074931.416236:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000082c5f7a4 reply state 00000000ac7cd4eb transno 4294969126 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416246:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.416253:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91604f4f9c00) 00010000:00010000:1.0:1769074931.416256:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074931.416258:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074931.416285:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec19e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb26 expref: 390 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.416304:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c600/0x557988ac98fec1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb26 expref: 389 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.416311:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a4:0x0].0x0 (ffff91604f4f9600) 00010000:00010000:1.0:1769074931.416314:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074931.416316:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c600, rc 0) 00000100:00100000:1.0:1769074931.416384:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+390:67757:x1855007616188928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 986us (1186us total) trans 4294969126 rc 0/0 00000100:00100000:1.0:1769074931.416391:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9709 00000100:00100000:3.0:1769074931.421727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.421857:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189056 00000100:00100000:2.0:1769074931.421868:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189056 00000100:00100000:2.0:1769074931.421926:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2813 00000100:00100000:2.0:1769074931.421935:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2419:x1855007616189056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.421955:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.421978:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb2d expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074931.422001:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074931.422021:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.422023:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.422032:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 215 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.422059:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 215 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.422074:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc 0) 00000100:00100000:2.0:1769074931.422137:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616189056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.422144:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2813 00000100:00100000:3.0:1769074931.426489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.426575:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189184 00000100:00100000:0.0:1769074931.426586:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189184 00000100:00100000:0.0:1769074931.426644:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2814 00000100:00100000:0.0:1769074931.426662:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:67757:x1855007616189184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.426680:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.426698:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb34 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.426730:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074931.426739:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.426741:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.426745:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb34 expref: 216 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.426778:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074931.426791:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074931.426805:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626639616:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074931.426902:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ac83300 going to sleep for 11 seconds 00000100:00100000:0.0:1769074931.429359:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626639616:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074931.429393:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb34 expref: 216 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.429419:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa800, rc 0) 00000100:00100000:0.0:1769074931.429478:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:67757:x1855007616189184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2825us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.429487:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2814 00000100:00100000:3.0:1769074931.432267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.432426:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189312 00000100:00100000:0.0:1769074931.432437:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189312 00010000:00010000:0.0:1769074931.432506:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074931.432585:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1934 00000100:00100000:0.0:1769074931.432596:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616189312:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074931.432612:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074931.432632:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.432645:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.432848:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fec1c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb2d expref: 216 pid: 24564 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.432867:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.432870:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.432877:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb34 expref: 215 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.432892:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb34 expref: 215 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.432931:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa800/0x557988ac98fec1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb34 expref: 215 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074931.432945:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626639744:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074931.433037:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ac83300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074931.438072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.438170:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189568 00000100:00100000:1.0:1769074931.438179:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189568 00000100:00100000:1.0:1769074931.438243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1919 00000100:00100000:1.0:1769074931.438252:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+390:67757:x1855007616189568:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074931.438571:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67757:x1855007616189568:12345-192.168.204.32@tcp:35:cp.0 Request processed in 319us (507us total) trans 4294969127 rc 0/0 00000100:00100000:1.0:1769074931.438580:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1919 00000100:00100000:0.0:1769074931.440898:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626639744:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074931.440925:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074931.440995:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616189312:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8401us (8737us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074931.441005:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1934 00000100:00100000:3.0:1769074931.482814:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.483238:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189696 00000100:00100000:0.0:1769074931.483251:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189696 00000100:00100000:0.0:1769074931.483313:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9710 00000100:00100000:0.0:1769074931.483325:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67760:x1855007616189696:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074931.483349:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.483372:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb3b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.483442:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.483458:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483469:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483483:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:0.0:1769074931.483489:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483494:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483597:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483605:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483611:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483616:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.483620:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483627:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483639:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.483642:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.483647:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483667:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483682:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483687:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483692:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483696:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.483699:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483703:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483710:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff916052ae5c00) 00010000:00010000:0.0:1769074931.483712:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.483714:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483720:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:0.0:1769074931.483751:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1cf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb3b expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.483760:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.483763:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.483766:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb3b expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.483779:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb400, rc 0) 00000100:00100000:0.0:1769074931.483851:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67760:x1855007616189696:12345-192.168.204.32@tcp:101:bash.0 Request processed in 528us (1050us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.483859:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9710 00000100:00100000:3.0:1769074931.498020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.498082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.498195:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189952 00000100:00100000:0.0:1769074931.498216:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189952 00000100:00100000:0.0:1769074931.498281:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 258 00000100:00100000:0.0:1769074931.498291:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:2420:x1855007616189952:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074931.498337:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.498359:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1e4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb49 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.498429:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074931.498446:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498458:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498473:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074931.498479:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498486:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498610:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498618:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498625:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498630:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.498634:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498642:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498869:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.498874:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.498880:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498887:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec1eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498905:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498911:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498917:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498922:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.498925:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498929:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498937:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff916052ae5c00) 00010000:00010000:0.0:1769074931.498940:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.498942:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498947:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec1f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.498979:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1e4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb49 expref: 392 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.498990:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.498993:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074931.498997:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec1e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb49 expref: 392 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.499006:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb400, rc -2) 00000100:00100000:0.0:1769074931.499085:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:2420:x1855007616189952:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 795us (1001us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074931.499094:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 258 00000100:00100000:1.0:1769074931.499181:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616189824 00000100:00100000:1.0:1769074931.499188:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616189824 00000100:00100000:1.0:1769074931.499234:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9711 00000100:00100000:1.0:1769074931.499241:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67761:x1855007616189824:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.499253:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.499265:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec1f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.499308:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.499320:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499328:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499341:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.499347:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499353:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499389:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499395:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499401:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499406:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499411:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.499414:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499419:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499427:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.499430:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.499433:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499438:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec200 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499447:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499453:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499458:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499463:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48de00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.499465:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499471:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499477:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff91604f4f9b00) 00010000:00010000:1.0:1769074931.499479:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.499482:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499487:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48de00/0x557988ac98fec207 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.499522:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec1f9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb42 expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.499781:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.499783:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.499787:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec1f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb42 expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.499797:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074931.499841:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67761:x1855007616189824:12345-192.168.204.32@tcp:101:rm.0 Request processed in 601us (1831us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.499848:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9711 00000100:00100000:3.0:1769074931.504093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.504181:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190080 00000100:00100000:1.0:1769074931.504191:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190080 00000100:00100000:1.0:1769074931.504253:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9712 00000100:00100000:1.0:1769074931.504263:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67761:x1855007616190080:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.504283:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.504304:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec20e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.504368:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.504383:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504393:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504407:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.504417:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504423:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504474:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504482:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504487:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504507:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504513:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.504517:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504525:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504571:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.504575:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.504580:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec215 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504599:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504605:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504611:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504615:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.504618:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504623:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.504633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.504635:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504641:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec21c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.504687:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec20e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb50 expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.504697:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.504699:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.504703:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec20e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb50 expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.504712:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074931.504777:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67761:x1855007616190080:12345-192.168.204.32@tcp:101:rm.0 Request processed in 515us (693us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.504786:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9712 00000100:00100000:0.0:1769074931.524774:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.524945:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190208 00000100:00100000:2.0:1769074931.524957:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190208 00000100:00100000:2.0:1769074931.525022:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9713 00000100:00100000:2.0:1769074931.525032:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67762:x1855007616190208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.525062:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.525084:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec223 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb57 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.525157:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.525172:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525185:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525202:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.525219:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525226:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525278:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525286:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525292:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525298:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.525303:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525310:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525326:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.525330:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.525334:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525340:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec22a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525353:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525359:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525364:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525369:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.525372:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525377:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525383:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff9161748d2100) 00010000:00010000:2.0:1769074931.525385:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.525388:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525392:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec231 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.525423:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec223 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb57 expref: 392 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.525433:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.525435:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.525438:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec223 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb57 expref: 392 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.525446:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074931.525513:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67762:x1855007616190208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 483us (750us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.525521:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9713 00000100:00100000:3.0:1769074931.530843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.531011:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190336 00000100:00100000:1.0:1769074931.531022:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190336 00000100:00100000:1.0:1769074931.531094:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9714 00000100:00100000:1.0:1769074931.531104:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67762:x1855007616190336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.531125:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.531144:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec238 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.531225:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.531240:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531252:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531267:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.531275:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531282:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531338:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531345:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531356:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531362:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531367:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.531372:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531379:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531390:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.531393:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.531398:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec23f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531417:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531422:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531427:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531431:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.531434:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531442:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531449:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.531451:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.531454:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531459:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec246 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.531490:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec238 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb5e expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.531500:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.531502:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.531506:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec238 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb5e expref: 392 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.531515:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48da00, rc 0) 00000100:00100000:1.0:1769074931.531635:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67762:x1855007616190336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 531us (802us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.531642:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9714 00000100:00100000:3.0:1769074931.536594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.536695:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190592 00000100:00100000:2.0:1769074931.536708:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190592 00000100:00100000:2.0:1769074931.536764:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9715 00000100:00100000:2.0:1769074931.536774:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67762:x1855007616190592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.536795:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.536815:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec24d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb65 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.536931:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.536949:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.536963:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.536978:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xaa00019 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.536989:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.536995:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:2.0:1769074931.537327:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xce:0x0], index 1: 0 00010000:00010000:2.0:1769074931.537477:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec262 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.537486:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec262 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537494:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec262 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537523:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537555:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537562:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537568:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e280400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.537572:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537579:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537591:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.537595:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.537599:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537605:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e280400/0x557988ac98fec254 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:2.0:1769074931.537618:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb0cad23 reply state 000000000179bc86 transno 4294969128 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537628:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.537634:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff9161748d2100) 00010000:00010000:2.0:1769074931.537636:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074931.537639:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074931.537667:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fec24d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb65 expref: 394 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.537681:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f499a00/0x557988ac98fec262 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb65 expref: 393 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.537688:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a5:0x0].0x0 (ffff9161748d2300) 00010000:00010000:2.0:1769074931.537691:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074931.537693:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f499a00, rc 0) 00000100:00100000:2.0:1769074931.537765:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+394:67762:x1855007616190592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 991us (1181us total) trans 4294969128 rc 0/0 00000100:00100000:2.0:1769074931.537773:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9715 00000100:00100000:3.0:1769074931.542580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.542688:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190720 00000100:00100000:2.0:1769074931.542699:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190720 00000100:00100000:2.0:1769074931.542759:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2815 00000100:00100000:2.0:1769074931.542769:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2419:x1855007616190720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.542790:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.542838:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb6c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074931.542865:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074931.542885:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.542887:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.542895:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 214 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.542912:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 214 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.542926:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074931.542981:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2419:x1855007616190720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 213us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.542988:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2815 00000100:00100000:3.0:1769074931.547439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.547988:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190848 00000100:00100000:2.0:1769074931.547998:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190848 00000100:00100000:2.0:1769074931.548110:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2816 00000100:00100000:2.0:1769074931.548120:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:67762:x1855007616190848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.548138:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.548156:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb73 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.548187:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 215 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.548211:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.548213:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.548218:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb73 expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.548253:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 215 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.548267:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 215 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074931.548280:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626639872:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074931.548479:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160449f3540 going to sleep for 11 seconds 00000100:00100000:3.0:1769074931.552843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.553228:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616190976 00000100:00100000:0.0:1769074931.553238:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616190976 00010000:00010000:0.0:1769074931.553291:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 216 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:0.0:1769074931.553336:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1935 00000100:00100000:0.0:1769074931.553345:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2420:x1855007616190976:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074931.553361:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074931.553380:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 216 pid: 25313 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.553394:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 216 pid: 25313 timeout: 2020 lvb_type: 1 00010000:00010000:0.0:1769074931.553418:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.553420:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.553428:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb73 expref: 216 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.553438:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb73 expref: 216 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.553475:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb73 expref: 216 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074931.553489:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626640000:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074931.553898:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ac83300 going to sleep for 11 seconds 00010000:00010000:2.0:1769074931.554379:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f422a00/0x557988ac98fec270 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb6c expref: 216 pid: 25313 timeout: 2020 lvb_type: 1 00000100:00100000:2.0:1769074931.554394:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626639872:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074931.554426:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f422600/0x557988ac98fec277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb73 expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.554437:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422600, rc 0) 00000100:00100000:2.0:1769074931.554480:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:67762:x1855007616190848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6360us (7049us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.554489:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2816 00000100:00100000:1.0:1769074931.558418:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626640000:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074931.558446:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074931.558592:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616190976:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5246us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.558603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1935 00000100:00100000:2.0:1769074931.561155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.561289:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191232 00000100:00100000:0.0:1769074931.561299:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191232 00000100:00100000:0.0:1769074931.561356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1920 00000100:00100000:0.0:1769074931.561366:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+394:67762:x1855007616191232:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074931.561704:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67762:x1855007616191232:12345-192.168.204.32@tcp:35:cp.0 Request processed in 338us (557us total) trans 4294969129 rc 0/0 00000100:00100000:0.0:1769074931.561713:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1920 00000100:00100000:2.0:1769074931.602515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.602664:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191360 00000100:00100000:1.0:1769074931.602676:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191360 00000100:00100000:1.0:1769074931.602740:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9716 00000100:00100000:1.0:1769074931.602749:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67765:x1855007616191360:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074931.602769:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.602789:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec27e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.602857:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.602871:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602881:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602895:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.602901:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602916:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602968:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602975:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602980:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602990:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.602995:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.602998:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603005:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603017:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.603021:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.603026:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603031:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec285 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603054:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603059:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603064:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603068:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.603071:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603077:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603087:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.603089:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.603092:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603097:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec28c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.603128:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec27e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb7a expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.603139:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.603141:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.603145:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec27e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb7a expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.603153:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c400, rc 0) 00000100:00100000:1.0:1769074931.603208:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67765:x1855007616191360:12345-192.168.204.32@tcp:101:bash.0 Request processed in 460us (717us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.603216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9716 00000100:00100000:3.0:1769074931.621261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.621424:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191488 00000100:00100000:2.0:1769074931.621435:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191488 00000100:00100000:2.0:1769074931.621574:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9717 00000100:00100000:2.0:1769074931.621585:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67766:x1855007616191488:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074931.621609:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.621629:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec293 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb81 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.621709:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.621724:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621735:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621748:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.621755:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621762:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621811:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621818:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621825:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621833:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.621837:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621845:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621858:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.621861:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.621866:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621872:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec29a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621887:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621892:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621897:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621915:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.621919:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621926:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621933:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff9161748d2800) 00010000:00010000:2.0:1769074931.621937:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.621940:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621945:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec2a1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.621977:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec293 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb81 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.621988:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.621990:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.621993:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec293 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb81 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.622002:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422800, rc 0) 00000100:00100000:2.0:1769074931.622079:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67766:x1855007616191488:12345-192.168.204.32@tcp:101:rm.0 Request processed in 496us (826us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.622088:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9717 00000100:00100000:0.0:1769074931.626156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.627617:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191616 00000100:00100000:3.0:1769074931.627632:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191616 00000100:00100000:3.0:1769074931.627709:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 259 00000100:00100000:3.0:1769074931.627719:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:2419:x1855007616191616:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074931.627775:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.627795:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec2a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bb88 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.627856:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.627872:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.627883:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.627899:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.628080:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628088:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628153:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628159:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628166:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628172:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.628177:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628184:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628202:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.628205:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.628211:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628217:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec2af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628232:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628239:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628245:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628250:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052a74e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.628253:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628258:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628265:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff916052a4fb00) 00010000:00010000:3.0:1769074931.628267:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.628270:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628276:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052a74e00/0x557988ac98fec2b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.628306:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec2a8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb88 expref: 396 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.628317:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.628320:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074931.628323:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec2a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bb88 expref: 396 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.628333:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc -2) 00000100:00100000:3.0:1769074931.628416:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:2419:x1855007616191616:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 698us (2268us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074931.628424:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 259 00000100:00100000:3.0:1769074931.632471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.633644:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191744 00000100:00100000:2.0:1769074931.633656:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191744 00000100:00100000:2.0:1769074931.633725:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9718 00000100:00100000:2.0:1769074931.633735:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67766:x1855007616191744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074931.633755:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.633775:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bbc0 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.633840:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.633854:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633866:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633879:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.633886:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633892:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633941:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633948:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633953:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633960:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.633964:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633971:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633982:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.633985:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.633990:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.633995:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634010:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634015:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634020:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634024:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.634027:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634032:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634039:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff9161748d2a00) 00010000:00010000:2.0:1769074931.634051:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.634055:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634060:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.634089:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbc0 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.634099:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.634101:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.634105:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbc0 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.634120:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074931.634259:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67766:x1855007616191744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 524us (1796us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.634265:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9718 00000100:00100000:1.0:1769074931.636629:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626640128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769074931.636708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074931.636813:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626640128 00000100:00100000:1.0:1769074931.636821:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626640128 00000100:00100000:1.0:1769074931.636869:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1769074931.636876:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626640128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1769074931.636898:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2924544 granted 493317056 pending 430080 free 3764432896 avail 3532910592 00000100:00100000:1.0:1769074931.636956:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626640128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.636964:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1769074931.637011:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626640128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1769074931.642702:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626640256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769074931.642772:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074931.643060:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626640256 00000100:00100000:2.0:1769074931.643068:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626640256 00000100:00100000:2.0:1769074931.643125:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1769074931.643134:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626640256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1769074931.643157:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2981888 granted 493280192 pending 430080 free 3915644928 avail 3684122624 00000100:00100000:2.0:1769074931.643222:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626640256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.643229:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1769074931.643721:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626640256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769074931.665777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.665877:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616191872 00000100:00100000:0.0:1769074931.665888:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616191872 00000100:00100000:0.0:1769074931.665961:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9719 00000100:00100000:0.0:1769074931.665970:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67769:x1855007616191872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.665991:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.666010:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec2d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bbc7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.666090:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.666106:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666119:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666134:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.666141:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666147:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666215:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666222:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666228:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666234:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666241:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.666245:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666252:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666264:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.666267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.666272:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666278:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec2d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666293:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666299:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666304:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666310:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.666313:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666319:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666326:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff916052ae5c00) 00010000:00010000:0.0:1769074931.666328:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.666330:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666335:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec2e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.666364:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec2d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbc7 expref: 396 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.666374:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.666377:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.666381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec2d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbc7 expref: 396 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.666389:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa400, rc 0) 00000100:00100000:0.0:1769074931.666454:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67769:x1855007616191872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 485us (687us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.666462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9719 00000100:00100000:0.0:1769074931.671526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.671764:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192000 00000100:00100000:2.0:1769074931.671774:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192000 00000100:00100000:2.0:1769074931.671830:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 260 00000100:00100000:2.0:1769074931.671839:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:2419:x1855007616192000:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074931.671900:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.671920:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bbce expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.671977:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.671990:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672000:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672014:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.672020:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672026:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672090:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672097:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672102:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672108:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.672112:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672120:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672132:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.672135:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.672141:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672146:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec2ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672160:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672166:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672171:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672175:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.672178:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672182:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672188:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff9161748d2a00) 00010000:00010000:2.0:1769074931.672191:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.672193:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672198:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec2f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.672236:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbce expref: 396 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.672246:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.672248:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074931.672251:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bbce expref: 396 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.672260:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc -2) 00000100:00100000:2.0:1769074931.672323:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:2419:x1855007616192000:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 484us (806us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074931.672332:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 260 00000100:00100000:3.0:1769074931.678676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.678772:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192128 00000100:00100000:2.0:1769074931.678784:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192128 00000100:00100000:2.0:1769074931.678844:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9720 00000100:00100000:2.0:1769074931.678855:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67769:x1855007616192128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.678877:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.678898:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc06 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.678974:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.678989:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679000:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679013:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.679020:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679025:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679086:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679093:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679100:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679106:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.679110:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679117:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679128:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.679131:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.679136:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679141:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec303 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679155:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679160:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679165:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679170:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.679173:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679178:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679188:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff9161748d2a00) 00010000:00010000:2.0:1769074931.679191:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.679193:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679197:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec30a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.679237:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc06 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.679247:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.679249:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.679252:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec2fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc06 expref: 396 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.679261:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074931.679336:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67769:x1855007616192128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 482us (669us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.679343:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9720 00000100:00100000:1.0:1769074931.683926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.684111:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192384 00000100:00100000:0.0:1769074931.684121:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192384 00000100:00100000:0.0:1769074931.684176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9721 00000100:00100000:0.0:1769074931.684185:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67769:x1855007616192384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.684211:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.684232:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec311 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.684337:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.684351:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.684361:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.684375:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x845fa817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.684381:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.684387:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074931.684958:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xce:0x0], index 0: 0 00010000:00010000:0.0:1769074931.685120:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fae00/0x557988ac98fec326 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.685130:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fae00/0x557988ac98fec326 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685137:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fae00/0x557988ac98fec326 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685168:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685174:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685181:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685186:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685192:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.685196:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685213:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685224:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.685227:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.685231:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685237:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec318 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074931.685250:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c1779fd3 reply state 00000000e1d4c7dc transno 4294969130 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685261:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.685267:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff916052ae5c00) 00010000:00010000:0.0:1769074931.685269:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074931.685272:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074931.685296:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec311 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc0d expref: 398 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.685307:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fae00/0x557988ac98fec326 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc0d expref: 397 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.685314:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a6:0x0].0x0 (ffff916052ae5200) 00010000:00010000:0.0:1769074931.685317:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074931.685319:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fae00, rc 0) 00000100:00100000:0.0:1769074931.685385:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+398:67769:x1855007616192384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1201us (1469us total) trans 4294969130 rc 0/0 00000100:00100000:0.0:1769074931.685392:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9721 00000100:00100000:1.0:1769074931.690367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.690958:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192512 00000100:00100000:2.0:1769074931.690969:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192512 00000100:00100000:2.0:1769074931.691025:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2817 00000100:00100000:2.0:1769074931.691034:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b79b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616192512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074931.691064:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.691087:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc14 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074931.691119:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074931.691141:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.691143:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074931.691153:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.691173:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074931.691185:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074931.691255:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b79b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2420:x1855007616192512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 221us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.691262:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2817 00000100:00100000:2.0:1769074931.697344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.697898:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192640 00000100:00100000:1.0:1769074931.698007:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192640 00000100:00100000:1.0:1769074931.698116:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2818 00000100:00100000:1.0:1769074931.698126:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:67769:x1855007616192640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.698146:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.698164:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc1b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.698195:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074931.698212:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074931.698214:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074931.698219:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc1b expref: 217 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.698253:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074931.698272:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074931.698286:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626640384:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074931.698385:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916042dead80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074931.702348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.702489:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616192768 00000100:00100000:0.0:1769074931.702513:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616192768 00010000:00010000:0.0:1769074931.702619:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:0.0:1769074931.702666:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1936 00000100:00100000:0.0:1769074931.702677:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616192768:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074931.702691:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074931.702713:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:0.0:1769074931.702729:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:0.0:1769074931.702761:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.702764:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.702772:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc1b expref: 218 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.702782:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc1b expref: 218 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.702819:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc1b expref: 218 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074931.702832:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049d23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626640512:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074931.704103:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6a80 going to sleep for 11 seconds 00010000:00010000:1.0:1769074931.704504:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fec334 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc14 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074931.704522:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626640384:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074931.704582:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48de00/0x557988ac98fec33b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc1b expref: 217 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.704595:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48de00, rc 0) 00000100:00100000:1.0:1769074931.704646:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:67769:x1855007616192640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6521us (7313us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.704666:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2818 00000100:00100000:2.0:1769074931.708145:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049d23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626640512:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074931.708171:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074931.708234:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616192768:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5558us (5896us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.708245:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1936 00000100:00100000:3.0:1769074931.715424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.715580:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193024 00000100:00100000:0.0:1769074931.715591:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193024 00000100:00100000:0.0:1769074931.715660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1921 00000100:00100000:0.0:1769074931.715671:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+398:67769:x1855007616193024:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074931.715966:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67769:x1855007616193024:12345-192.168.204.32@tcp:35:cp.0 Request processed in 296us (550us total) trans 4294969131 rc 0/0 00000100:00100000:0.0:1769074931.715975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1921 00000100:00100000:3.0:1769074931.746948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.747439:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193152 00000100:00100000:0.0:1769074931.747450:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193152 00000100:00100000:0.0:1769074931.747514:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 261 00000100:00100000:0.0:1769074931.747526:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2417:x1855007616193152:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074931.747628:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.747661:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec342 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc22 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.747721:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074931.747735:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747746:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747760:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074931.747766:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747773:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747826:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747834:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747840:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747846:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.747851:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747859:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747872:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.747875:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.747880:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747885:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec349 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747899:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747913:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747919:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747924:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.747926:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747931:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747937:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff916052ae5800) 00010000:00010000:0.0:1769074931.747939:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.747941:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747946:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec350 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074931.747973:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec342 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc22 expref: 400 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.747983:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.747985:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074931.747988:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec342 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc22 expref: 400 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.747997:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb200, rc -2) 00000100:00100000:0.0:1769074931.748082:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2417:x1855007616193152:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 558us (1144us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074931.748090:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 261 00000100:00100000:0.0:1769074931.771194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.771372:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193280 00000100:00100000:1.0:1769074931.771382:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193280 00000100:00100000:1.0:1769074931.771454:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9722 00000100:00100000:1.0:1769074931.771464:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67776:x1855007616193280:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074931.771485:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.771694:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec357 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc5a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.771775:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.771789:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771799:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771815:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.771822:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771828:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771884:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771892:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.771898:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772079:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772086:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.772091:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772102:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772115:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.772118:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.772123:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772130:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec35e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772145:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772152:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772158:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772163:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.772166:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772171:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772178:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.772180:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.772183:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec365 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.772348:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec357 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc5a expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.772360:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.772362:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.772366:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec357 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc5a expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.772376:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074931.772635:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67776:x1855007616193280:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1171us (1450us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.772643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9722 00000100:00100000:3.0:1769074931.790103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.790221:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193408 00000100:00100000:1.0:1769074931.790233:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193408 00000100:00100000:1.0:1769074931.790302:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9723 00000100:00100000:1.0:1769074931.790311:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67777:x1855007616193408:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.790333:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.790355:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec36c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.790422:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.790437:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790449:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790467:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.790473:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790479:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790584:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790592:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790597:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790603:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790608:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.790612:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790619:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790632:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.790635:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.790639:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790645:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec373 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790672:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790676:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790681:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790685:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.790688:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790693:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790700:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.790702:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.790705:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790710:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec37a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.790742:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec36c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc61 expref: 400 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.790751:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.790753:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.790757:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec36c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc61 expref: 400 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.790769:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074931.790825:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67777:x1855007616193408:12345-192.168.204.32@tcp:101:rm.0 Request processed in 515us (731us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.790833:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9723 00000100:00100000:3.0:1769074931.795968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.796162:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193536 00000100:00100000:2.0:1769074931.796172:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193536 00000100:00100000:2.0:1769074931.796242:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 262 00000100:00100000:2.0:1769074931.796253:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2418:x1855007616193536:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074931.796288:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.796308:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec381 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc68 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.796367:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.796382:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796392:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796407:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074931.796414:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796420:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796471:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796477:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796483:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796489:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.796493:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796499:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796515:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.796518:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.796523:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796567:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec388 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796583:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796590:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796595:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796600:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.796603:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796609:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796615:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff9161748d2c00) 00010000:00010000:2.0:1769074931.796617:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.796621:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796625:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423400/0x557988ac98fec38f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074931.796652:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec381 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc68 expref: 400 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.796661:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.796664:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074931.796667:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec381 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc68 expref: 400 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.796675:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423200, rc -2) 00000100:00100000:2.0:1769074931.796732:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2418:x1855007616193536:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 481us (774us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074931.796740:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 262 00000100:00100000:0.0:1769074931.800645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.800755:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193664 00000100:00100000:2.0:1769074931.800765:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193664 00000100:00100000:2.0:1769074931.800827:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9724 00000100:00100000:2.0:1769074931.800836:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67777:x1855007616193664:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074931.800857:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074931.800879:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec396 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc6f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.800954:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.800969:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.800981:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.800996:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074931.801006:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801013:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801074:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801082:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801089:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801095:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.801099:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801107:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801119:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.801123:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.801127:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801134:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec39d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801149:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801156:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801162:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801167:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074931.801170:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801175:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801182:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff9161748d2400) 00010000:00010000:2.0:1769074931.801185:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.801188:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801193:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fec3a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074931.801233:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec396 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc6f expref: 400 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.801243:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074931.801246:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074931.801249:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec396 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc6f expref: 400 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.801259:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:2.0:1769074931.801317:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67777:x1855007616193664:12345-192.168.204.32@tcp:101:rm.0 Request processed in 483us (682us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074931.801325:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9724 00000100:00100000:3.0:1769074931.822846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.825457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.825608:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193920 00000100:00100000:3.0:1769074931.825619:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193920 00000100:00100000:3.0:1769074931.825688:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 263 00000100:00100000:3.0:1769074931.825698:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2419:x1855007616193920:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074931.825735:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.825755:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec3ab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc7d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.825816:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.825829:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.825840:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.825853:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.825860:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.825866:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826136:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826145:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826152:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826158:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.826162:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826170:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826186:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.826189:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.826193:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826211:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec3b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826225:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826231:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826237:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826242:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.826245:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826250:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826257:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff916052a4fb00) 00010000:00010000:3.0:1769074931.826260:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.826262:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826269:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec3b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.826299:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec3ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc7d expref: 400 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.826309:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.826311:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074931.826314:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec3ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc7d expref: 400 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.826323:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc -2) 00000100:00100000:3.0:1769074931.826398:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:2419:x1855007616193920:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 701us (949us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074931.826406:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 263 00000100:00100000:1.0:1769074931.827088:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616193792 00000100:00100000:1.0:1769074931.827096:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616193792 00000100:00100000:1.0:1769074931.827137:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9725 00000100:00100000:1.0:1769074931.827146:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67778:x1855007616193792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.827160:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.827176:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec3c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.827232:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.827245:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827253:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827264:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.827270:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827275:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827319:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827327:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827333:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827339:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827345:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.827349:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827355:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827364:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.827367:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.827370:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827376:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec3c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827387:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827393:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827399:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827404:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48dc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.827407:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827413:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91604f4f9d00) 00010000:00010000:1.0:1769074931.827422:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.827425:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827429:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec3ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.827455:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec3c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc76 expref: 400 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.827464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.827466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.827469:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec3c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc76 expref: 400 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.827477:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074931.827580:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67778:x1855007616193792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 435us (4742us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.827587:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9725 00000100:00100000:0.0:1769074931.832255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.832348:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194048 00000100:00100000:1.0:1769074931.832359:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194048 00000100:00100000:1.0:1769074931.832419:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9726 00000100:00100000:1.0:1769074931.832428:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67778:x1855007616194048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.832449:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.832471:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec3d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc84 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.832581:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.832597:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832609:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832624:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.832630:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832635:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832688:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832695:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832701:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832706:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.832711:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832718:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832729:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.832733:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.832738:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832744:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec3dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832757:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832762:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832767:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832771:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.832774:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832779:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832785:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff91604f4f9b00) 00010000:00010000:1.0:1769074931.832787:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.832789:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832796:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec3e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.832825:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec3d5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc84 expref: 400 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.832833:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.832835:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.832838:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec3d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc84 expref: 400 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.832845:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c000, rc 0) 00000100:00100000:1.0:1769074931.833007:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67778:x1855007616194048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 580us (761us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.833015:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9726 00000100:00100000:3.0:1769074931.838949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.839258:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194304 00000100:00100000:0.0:1769074931.839269:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194304 00000100:00100000:0.0:1769074931.839331:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9727 00000100:00100000:0.0:1769074931.839341:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67778:x1855007616194304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074931.839362:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.839381:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec3ea lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc8b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.839513:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.839560:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.839572:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.839590:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.839599:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.839604:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074931.840348:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xcf:0x0], index 1: 0 00010000:00010000:0.0:1769074931.840827:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa200/0x557988ac98fec3ff lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.840840:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa200/0x557988ac98fec3ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.840847:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa200/0x557988ac98fec3ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.840884:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.840890:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.840895:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841114:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841120:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.841125:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841132:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841145:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.841148:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.841153:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841159:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec3f1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074931.841175:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000080e68a7 reply state 00000000b22b0215 transno 4294969132 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841185:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.841191:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff916052ae5800) 00010000:00010000:0.0:1769074931.841193:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074931.841207:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074931.841242:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec3ea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc8b expref: 402 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.841258:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa200/0x557988ac98fec3ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc8b expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.841265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a7:0x0].0x0 (ffff916052ae5a00) 00010000:00010000:0.0:1769074931.841267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074931.841269:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa200, rc 0) 00000100:00100000:0.0:1769074931.841343:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+402:67778:x1855007616194304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2003us (2404us total) trans 4294969132 rc 0/0 00000100:00100000:0.0:1769074931.841354:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9727 00000100:00100000:3.0:1769074931.846405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.846583:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194432 00000100:00100000:1.0:1769074931.846595:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194432 00000100:00100000:1.0:1769074931.846660:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2819 00000100:00100000:1.0:1769074931.846671:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616194432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.846690:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.846712:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc92 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074931.846735:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074931.846753:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074931.846756:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074931.846764:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 215 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074931.846786:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 215 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074931.846804:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c000, rc 0) 00000100:00100000:1.0:1769074931.846864:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616194432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 195us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.846871:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2819 00000100:00100000:2.0:1769074931.854277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.854431:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194560 00000100:00100000:3.0:1769074931.854445:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194560 00000100:00100000:3.0:1769074931.854507:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2820 00000100:00100000:3.0:1769074931.854518:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:67778:x1855007616194560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074931.854578:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.854597:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bc99 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.854631:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074931.854640:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.854642:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074931.854656:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc99 expref: 216 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.854698:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074931.854712:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 2021 lvb_type: 1 00000100:00100000:3.0:1769074931.854726:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626640640:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074931.854831:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617bb8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1769074931.858454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074931.858696:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626640640:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074931.858735:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc99 expref: 216 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074931.858757:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052a74e00, rc 0) 00000100:00100000:2.0:1769074931.858823:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:67778:x1855007616194560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4307us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074931.858832:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2820 00000100:00100000:0.0:1769074931.858929:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194688 00000100:00100000:0.0:1769074931.858937:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194688 00010000:00010000:0.0:1769074931.858985:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 2021 lvb_type: 1 00000100:00100000:0.0:1769074931.859022:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1937 00000100:00100000:0.0:1769074931.859031:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161784cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616194688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074931.859053:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074931.859073:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:0.0:1769074931.859087:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:0.0:1769074931.859112:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c000/0x557988ac98fec40d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc92 expref: 216 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:0.0:1769074931.859127:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.859129:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074931.859135:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc99 expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.859145:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc99 expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.859187:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052a74e00/0x557988ac98fec414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bc99 expref: 215 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074931.859214:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626640768:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074931.859272:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074931.864208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.864330:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626640768:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074931.864360:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074931.864422:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161784cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616194688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5391us (5976us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074931.864433:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1937 00000100:00100000:3.0:1769074931.864730:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616194944 00000100:00100000:3.0:1769074931.864738:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616194944 00000100:00100000:3.0:1769074931.864788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1922 00000100:00100000:3.0:1769074931.864796:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+402:67778:x1855007616194944:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074931.865079:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67778:x1855007616194944:12345-192.168.204.32@tcp:35:cp.0 Request processed in 283us (892us total) trans 4294969133 rc 0/0 00000100:00100000:3.0:1769074931.865086:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1922 00010000:00010000:0.0:1769074931.891695:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074931.913450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.913614:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195072 00000100:00100000:0.0:1769074931.913625:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195072 00000100:00100000:0.0:1769074931.913697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9728 00000100:00100000:0.0:1769074931.913707:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67782:x1855007616195072:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074931.913728:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074931.913750:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec41b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bca0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.913816:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.913830:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913841:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913856:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074931.913862:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913870:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913924:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913931:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913937:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913943:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913950:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.913954:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913961:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913974:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.913977:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.913982:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.913989:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec422 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914003:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914008:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914015:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914020:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074931.914023:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914029:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914065:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff916052ae5400) 00010000:00010000:0.0:1769074931.914068:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.914071:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914077:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec429 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074931.914108:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec41b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bca0 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.914117:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074931.914119:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074931.914123:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb800/0x557988ac98fec41b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bca0 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074931.914132:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb800, rc 0) 00000100:00100000:0.0:1769074931.914205:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67782:x1855007616195072:12345-192.168.204.32@tcp:101:bash.0 Request processed in 492us (758us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074931.914213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9728 00000100:00100000:0.0:1769074931.928353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074931.928405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.928500:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195200 00000100:00100000:1.0:1769074931.928510:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195200 00000100:00100000:1.0:1769074931.928602:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9729 00000100:00100000:1.0:1769074931.928612:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67783:x1855007616195200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.928637:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.928672:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec430 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bca7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.928737:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.928750:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928765:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928777:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.928782:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928788:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928833:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928840:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928846:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928852:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.928856:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928862:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928873:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.928876:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.928881:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928886:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec437 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928899:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928905:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928911:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928916:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.928919:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928925:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928931:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9100) 00010000:00010000:1.0:1769074931.928933:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.928935:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928940:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec43e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.928966:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec430 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bca7 expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.928975:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.928977:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.928980:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec430 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bca7 expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.928991:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c400, rc 0) 00000100:00100000:1.0:1769074931.929064:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67783:x1855007616195200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 453us (722us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.929070:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9729 00000100:00100000:3.0:1769074931.929402:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195328 00000100:00100000:3.0:1769074931.929408:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195328 00000100:00100000:3.0:1769074931.929447:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 264 00000100:00100000:3.0:1769074931.929453:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:2417:x1855007616195328:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074931.929474:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.929484:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec445 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcae expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.929564:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.929574:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929582:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929595:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.929602:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929608:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929638:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929655:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929661:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929666:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.929669:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929675:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929686:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.929688:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.929691:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929696:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec44c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929705:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929710:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929715:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929720:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.929722:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929727:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929734:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff916052a4fb00) 00010000:00010000:3.0:1769074931.929737:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.929739:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929745:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec453 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.929764:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec445 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcae expref: 404 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.929773:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.929775:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074931.929778:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec445 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcae expref: 404 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.929786:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc -2) 00000100:00100000:3.0:1769074931.929995:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:2417:x1855007616195328:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 540us (1587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074931.930002:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 264 00000100:00100000:0.0:1769074931.935308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.935390:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195456 00000100:00100000:1.0:1769074931.935401:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195456 00000100:00100000:1.0:1769074931.935461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9730 00000100:00100000:1.0:1769074931.935471:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67783:x1855007616195456:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074931.935502:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.935526:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec45a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcb5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.935657:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.935672:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935684:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935698:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074931.935704:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935710:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935766:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935774:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935779:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935785:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935791:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.935795:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935802:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935813:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.935817:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.935822:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935828:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec461 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935839:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935845:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935850:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935855:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.935858:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935864:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935870:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9100) 00010000:00010000:1.0:1769074931.935872:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.935874:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935879:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec468 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074931.935906:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec45a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcb5 expref: 404 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.935916:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.935918:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.935921:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec45a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcb5 expref: 404 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.935928:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074931.935981:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67783:x1855007616195456:12345-192.168.204.32@tcp:101:rm.0 Request processed in 511us (683us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.935988:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9730 00000100:00100000:0.0:1769074931.968145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.968340:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195584 00000100:00100000:1.0:1769074931.968350:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195584 00000100:00100000:1.0:1769074931.968449:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9731 00000100:00100000:1.0:1769074931.968459:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67784:x1855007616195584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.968480:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.968513:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec46f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcbc expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.968621:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.968637:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968658:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968673:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.968679:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968685:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968738:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968746:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968752:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968759:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.968763:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968769:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968780:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.968783:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.968787:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968793:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec476 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968804:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968811:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968816:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968820:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.968823:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968828:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968836:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9100) 00010000:00010000:1.0:1769074931.968838:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.968840:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968848:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec47d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.968877:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec46f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcbc expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.968886:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.968888:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.968891:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec46f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcbc expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.968900:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074931.968967:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67784:x1855007616195584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 508us (832us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.968975:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9731 00000100:00100000:2.0:1769074931.985158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074931.985250:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195840 00000100:00100000:3.0:1769074931.985260:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195840 00000100:00100000:3.0:1769074931.985318:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 265 00000100:00100000:3.0:1769074931.985328:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:2417:x1855007616195840:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074931.985381:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074931.985400:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec484 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcca expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.985457:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.985471:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985482:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985496:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074931.985506:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985512:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985592:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985599:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985605:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985611:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b9a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.985614:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985621:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985632:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.985635:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.985639:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985644:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec48b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985656:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985661:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985667:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985671:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074931.985674:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985679:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985686:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff916052a4fb00) 00010000:00010000:3.0:1769074931.985688:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074931.985690:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985696:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec492 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074931.985723:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec484 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcca expref: 404 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.985732:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074931.985735:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074931.985738:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec484 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcca expref: 404 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074931.985748:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc -2) 00000100:00100000:3.0:1769074931.985815:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:2417:x1855007616195840:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 489us (666us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074931.985823:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 265 00000100:00100000:3.0:1769074931.992302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.992511:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616195712 00000100:00100000:1.0:1769074931.992525:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616195712 00000100:00100000:1.0:1769074931.992612:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9732 00000100:00100000:1.0:1769074931.992624:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67784:x1855007616195712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.992645:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.992666:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec499 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcc3 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.992733:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.992748:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992762:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992775:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.992781:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992786:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992836:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992843:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992849:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992855:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.992859:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992867:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992878:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.992882:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.992886:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.992892:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec4a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993145:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993151:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993156:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993162:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.993165:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993171:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993179:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9100) 00010000:00010000:1.0:1769074931.993182:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.993185:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993190:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec4a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.993223:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec499 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcc3 expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.993232:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.993234:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.993238:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec499 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcc3 expref: 404 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.993252:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074931.993317:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67784:x1855007616195712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 695us (1023us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074931.993325:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9732 00000100:00100000:0.0:1769074931.996605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074931.996757:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196096 00000100:00100000:1.0:1769074931.996769:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196096 00000100:00100000:1.0:1769074931.996820:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9733 00000100:00100000:1.0:1769074931.996831:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67784:x1855007616196096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074931.996855:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074931.996874:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec4ae lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcd1 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.997250:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.997265:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.997276:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.997290:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.997295:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.997301:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074931.997866:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xcf:0x0], index 0: 0 00010000:00010000:1.0:1769074931.999522:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec4c3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074931.999562:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec4c3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999573:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec4c3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999611:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999617:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999624:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999629:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074931.999634:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999641:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999653:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074931.999657:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074931.999660:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999666:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4b5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074931.999684:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000062318ecb reply state 00000000ff8f0f20 transno 4294969134 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999693:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074931.999699:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9700) 00010000:00010000:1.0:1769074931.999701:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074931.999704:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074931.999741:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec4ae lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd1 expref: 406 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.999756:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48dc00/0x557988ac98fec4c3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd1 expref: 405 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074931.999764:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a8:0x0].0x0 (ffff91604f4f9100) 00010000:00010000:1.0:1769074931.999766:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074931.999768:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48dc00, rc 0) 00000100:00100000:1.0:1769074931.999848:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:67784:x1855007616196096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3017us (3249us total) trans 4294969134 rc 0/0 00000100:00100000:1.0:1769074931.999857:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9733 00000100:00100000:2.0:1769074932.005167:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.005243:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196224 00000100:00100000:3.0:1769074932.005254:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196224 00000100:00100000:3.0:1769074932.005343:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2821 00000100:00100000:3.0:1769074932.005352:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616196224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.005375:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.005394:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcd8 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074932.005418:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074932.005437:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.005440:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.005448:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.005464:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.005477:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074932.005558:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616196224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.005564:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2821 00000100:00100000:3.0:1769074932.024661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.025448:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196352 00000100:00100000:2.0:1769074932.025466:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196352 00000100:00100000:2.0:1769074932.025572:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2822 00000100:00100000:2.0:1769074932.025582:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:67784:x1855007616196352:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.025599:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.025618:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bcdf expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.025649:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074932.025656:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074932.025658:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074932.025662:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcdf expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.025694:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074932.025709:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:2.0:1769074932.025722:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626640896:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074932.025834:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160449f3540 going to sleep for 11 seconds 00000100:00100000:2.0:1769074932.028401:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626640896:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074932.028451:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcdf expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.028477:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423400, rc 0) 00000100:00100000:3.0:1769074932.036887:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:67784:x1855007616196352:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11286us (12215us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.036904:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2822 00000100:00100000:0.0:1769074932.042183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.042282:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196480 00000100:00100000:1.0:1769074932.042299:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196480 00010000:00010000:1.0:1769074932.042367:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074932.042559:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1938 00000100:00100000:1.0:1769074932.042569:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616196480:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074932.042588:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074932.042610:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.042625:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.042648:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b8400/0x557988ac98fec4d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcd8 expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.042663:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.042665:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.042672:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcdf expref: 217 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.042682:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcdf expref: 217 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.042736:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f423400/0x557988ac98fec4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bcdf expref: 217 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.042749:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626641024:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074932.042839:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.058277:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626641024:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074932.058316:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074932.058390:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616196480:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 15821us (16221us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.058401:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1938 00000100:00100000:0.0:1769074932.072005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.074588:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196736 00000100:00100000:1.0:1769074932.074603:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196736 00000100:00100000:1.0:1769074932.074681:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1923 00000100:00100000:1.0:1769074932.074691:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:67784:x1855007616196736:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074932.075239:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67784:x1855007616196736:12345-192.168.204.32@tcp:35:cp.0 Request processed in 547us (3241us total) trans 4294969135 rc 0/0 00000100:00100000:1.0:1769074932.075248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1923 00000100:00100000:0.0:1769074932.137374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.138060:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196864 00000100:00100000:2.0:1769074932.138071:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196864 00000100:00100000:2.0:1769074932.138136:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 266 00000100:00100000:2.0:1769074932.138145:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:2420:x1855007616196864:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074932.138200:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.138221:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec4df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bce6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.138273:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074932.138286:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138296:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138315:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074932.138322:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138327:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138449:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138457:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138463:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138468:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.138472:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138478:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138497:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.138500:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.138504:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138510:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec4e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138524:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138587:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138592:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138597:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.138600:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138606:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138613:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.138615:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.138618:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138623:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec4ed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074932.138650:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec4df lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bce6 expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.138660:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.138662:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074932.138665:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec4df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bce6 expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.138673:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423c00, rc -2) 00000100:00100000:2.0:1769074932.138733:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:2420:x1855007616196864:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 588us (1380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074932.138741:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 266 00000100:00100000:2.0:1769074932.165811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.166140:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616196992 00000100:00100000:1.0:1769074932.166153:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616196992 00000100:00100000:1.0:1769074932.166222:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9734 00000100:00100000:1.0:1769074932.166232:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67789:x1855007616196992:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074932.166252:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.166272:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec4f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd1e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.166339:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074932.166353:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166364:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166380:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074932.166387:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166408:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166461:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166468:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166474:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166480:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.166484:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166503:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166516:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.166519:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.166523:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166567:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec4fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166583:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166588:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166593:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166597:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.166600:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166605:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166612:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.166614:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.166617:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166622:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec502 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.166652:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec4f4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd1e expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.166661:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.166664:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.166668:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec4f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd1e expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.166676:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074932.166749:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67789:x1855007616196992:12345-192.168.204.32@tcp:101:bash.0 Request processed in 519us (948us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.166757:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9734 00000100:00100000:0.0:1769074932.185869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.187066:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.187999:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197120 00000100:00100000:0.0:1769074932.188013:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197120 00000100:00100000:0.0:1769074932.188137:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9735 00000100:00100000:0.0:1769074932.188147:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67790:x1855007616197120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074932.188167:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.188189:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec509 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd25 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.188257:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074932.188272:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188282:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188297:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074932.188303:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188314:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188365:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188372:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188378:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188383:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188396:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.188400:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.188408:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1769074932.189021:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197248 00000100:00100000:1.0:1769074932.189028:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197248 00000100:00100000:1.0:1769074932.189152:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 267 00000100:00100000:1.0:1769074932.189161:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:2418:x1855007616197248:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074932.189182:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.189186:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.189193:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.189201:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec510 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.189216:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.189218:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.189223:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.189228:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec51e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd2c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.189229:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.189235:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.189238:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.189243:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.189252:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff916052ae5400) 00010000:00010000:0.0:1769074932.189254:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.189257:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.189259:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074932.189262:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec517 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.189269:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189276:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189287:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074932.189290:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec509 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd25 expref: 410 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.189294:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074932.189299:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.189300:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074932.189302:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.189305:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec509 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd25 expref: 410 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.189312:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb400, rc 0) 00010000:00010000:1.0:1769074932.189328:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189345:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189350:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189361:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.189365:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189370:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00000100:00100000:0.0:1769074932.189376:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+409:67790:x1855007616197120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1230us (2318us total) trans 0 rc 301/301 00010000:00010000:1.0:1769074932.189378:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.189381:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074932.189384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9735 00010000:00010000:1.0:1769074932.189384:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189389:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec525 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189397:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189402:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189407:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189412:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.189415:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189420:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189426:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.189429:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.189431:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189441:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec52c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.189461:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec51e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd2c expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.189468:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.189471:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074932.189474:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec51e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd2c expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.189482:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc -2) 00000100:00100000:1.0:1769074932.189516:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:2418:x1855007616197248:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 357us (3658us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074932.189523:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 267 00000100:00100000:2.0:1769074932.194187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.194414:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197376 00000100:00100000:0.0:1769074932.194424:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197376 00000100:00100000:0.0:1769074932.194485:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9736 00000100:00100000:0.0:1769074932.194503:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67790:x1855007616197376:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074932.194524:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.194574:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec533 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd64 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.194639:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074932.194653:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194664:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194679:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074932.194685:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194690:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194744:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194751:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194756:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194766:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194771:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.194775:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194781:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194792:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.194795:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.194799:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194805:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec53a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194817:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194822:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194827:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194832:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.194834:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194839:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194848:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff916052ae5e00) 00010000:00010000:0.0:1769074932.194850:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.194852:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194857:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec541 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074932.194882:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec533 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd64 expref: 408 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.194889:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.194901:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.194905:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec533 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd64 expref: 408 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.194913:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa400, rc 0) 00000100:00100000:0.0:1769074932.194979:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67790:x1855007616197376:12345-192.168.204.32@tcp:101:rm.0 Request processed in 486us (800us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074932.194986:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9736 00000100:00100000:2.0:1769074932.220757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.220867:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197504 00000100:00100000:1.0:1769074932.220880:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197504 00000100:00100000:1.0:1769074932.220963:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9737 00000100:00100000:1.0:1769074932.220974:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67793:x1855007616197504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.220994:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.221013:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec548 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd6b expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.221099:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074932.221115:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221131:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221144:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074932.221150:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221155:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221208:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221216:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221222:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221228:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.221231:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221239:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221252:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.221255:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.221260:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221266:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec54f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221280:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221285:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221290:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221295:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.221298:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221303:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221310:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.221313:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.221315:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221321:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec556 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074932.221350:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec548 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd6b expref: 408 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.221360:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.221363:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.221366:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec548 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd6b expref: 408 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.221378:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074932.221786:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67793:x1855007616197504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 812us (1041us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.221796:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9737 00000100:00100000:3.0:1769074932.226085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.226326:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197632 00000100:00100000:2.0:1769074932.226347:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197632 00000100:00100000:2.0:1769074932.226454:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9738 00000100:00100000:2.0:1769074932.226465:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67793:x1855007616197632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.226487:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.226520:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec55d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd72 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.226820:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.226835:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.226846:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.226860:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.226867:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.226872:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227060:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227068:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227073:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227079:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.227083:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227089:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227102:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.227105:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.227110:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227115:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec564 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227127:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227132:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227137:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227141:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.227144:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227149:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227154:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.227156:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.227159:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227164:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec56b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.227273:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec55d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd72 expref: 408 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.227284:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.227286:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.227290:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec55d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd72 expref: 408 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.227298:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc 0) 00000100:00100000:2.0:1769074932.227372:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67793:x1855007616197632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 908us (1296us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.227379:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9738 00000100:00100000:3.0:1769074932.229424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.230212:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616197760 00000100:00100000:1.0:1769074932.230224:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616197760 00000100:00100000:1.0:1769074932.230272:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 268 00000100:00100000:1.0:1769074932.230281:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:2417:x1855007616197760:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074932.230342:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.230361:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec572 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bd79 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.230414:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.230428:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.230438:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.230452:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.230459:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.230465:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231042:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231051:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231057:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231062:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.231066:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231072:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231084:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.231087:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.231091:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231097:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec579 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231110:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231115:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231120:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231125:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.231127:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231132:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231138:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.231141:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.231144:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231149:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec580 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.231182:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec572 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd79 expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074932.231272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:1.0:1769074932.231293:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.231295:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074932.231299:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d800/0x557988ac98fec572 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bd79 expref: 408 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.231309:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc -2) 00000100:00100000:1.0:1769074932.231372:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:2417:x1855007616197760:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1092us (1956us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074932.231380:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 268 00000100:00100000:0.0:1769074932.235016:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198016 00000100:00100000:0.0:1769074932.235038:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198016 00000100:00100000:0.0:1769074932.235115:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9739 00000100:00100000:0.0:1769074932.235124:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67793:x1855007616198016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074932.235144:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.235164:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec587 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bdb1 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.235292:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074932.235306:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235316:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235330:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074932.235336:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235342:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074932.235648:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd0:0x0], index 1: 0 00010000:00010000:0.0:1769074932.235782:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec59c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074932.235791:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec59c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235798:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec59c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235825:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235831:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235843:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235849:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.235853:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235859:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235869:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.235872:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.235876:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.235881:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec58e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074932.236106:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b3bbd983 reply state 00000000d6e19052 transno 4294969136 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.236118:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074932.236124:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff916052ae5e00) 00010000:00010000:0.0:1769074932.236127:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074932.236129:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074932.236161:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec587 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb1 expref: 410 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.236175:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb400/0x557988ac98fec59c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb1 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.236188:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1a9:0x0].0x0 (ffff916052ae5400) 00010000:00010000:0.0:1769074932.236190:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074932.236193:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb400, rc 0) 00000100:00100000:0.0:1769074932.236262:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+410:67793:x1855007616198016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1139us (4990us total) trans 4294969136 rc 0/0 00000100:00100000:0.0:1769074932.236271:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9739 00000100:00100000:1.0:1769074932.239344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.239758:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198144 00000100:00100000:3.0:1769074932.239769:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198144 00000100:00100000:3.0:1769074932.239823:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2823 00000100:00100000:3.0:1769074932.239833:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616198144:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.239850:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.239870:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bdb8 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074932.239899:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074932.239918:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.239920:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.239929:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.239945:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 216 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.239958:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8000, rc 0) 00000100:00100000:3.0:1769074932.240020:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616198144:12345-192.168.204.32@tcp:101:cp.0 Request processed in 188us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.240028:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2823 00000100:00100000:0.0:1769074932.245188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.248694:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198272 00000100:00100000:1.0:1769074932.248711:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198272 00000100:00100000:1.0:1769074932.248791:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2824 00000100:00100000:1.0:1769074932.248800:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:67793:x1855007616198272:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.248820:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.248840:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bdbf expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.248869:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.248878:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.248880:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.248884:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdbf expref: 217 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.249338:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.249354:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074932.249368:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626641152:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074932.249829:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.254941:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626641152:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074932.254981:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdbf expref: 217 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.255003:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d800, rc 0) 00000100:00100000:1.0:1769074932.255088:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:67793:x1855007616198272:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6287us (9908us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.255098:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2824 00000100:00100000:0.0:1769074932.256418:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.256703:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198400 00000100:00100000:1.0:1769074932.256712:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198400 00010000:00010000:1.0:1769074932.256762:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074932.256801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1939 00000100:00100000:1.0:1769074932.256810:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616198400:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074932.256826:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074932.256846:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.256861:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.256886:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5aa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdb8 expref: 217 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.257599:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.257601:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.257612:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdbf expref: 216 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.257621:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdbf expref: 216 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.257818:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48d800/0x557988ac98fec5b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdbf expref: 216 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.257835:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626641280:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074932.258189:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074932.267009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.267506:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198656 00000100:00100000:0.0:1769074932.267516:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198656 00000100:00100000:0.0:1769074932.267615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1924 00000100:00100000:0.0:1769074932.267624:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+410:67793:x1855007616198656:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074932.268218:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67793:x1855007616198656:12345-192.168.204.32@tcp:35:cp.0 Request processed in 591us (1218us total) trans 4294969137 rc 0/0 00000100:00100000:2.0:1769074932.268227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1924 00000100:00100000:1.0:1769074932.269343:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626641280:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074932.269367:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074932.269407:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616198400:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12597us (12996us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.269417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1939 00000100:00100000:3.0:1769074932.300169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.300278:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198784 00000100:00100000:1.0:1769074932.300289:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198784 00000100:00100000:1.0:1769074932.300346:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 269 00000100:00100000:1.0:1769074932.300356:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:2417:x1855007616198784:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074932.300430:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.300451:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bdc6 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.300523:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.300578:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300589:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300607:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.300614:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300621:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300680:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300685:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300690:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300693:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.300697:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300701:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300710:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.300712:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.300716:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300719:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300728:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300732:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300735:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300738:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.300739:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300742:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300745:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.300747:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.300748:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300751:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5c6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.300770:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5b8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdc6 expref: 412 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.300776:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.300777:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074932.300779:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdc6 expref: 412 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.300785:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc -2) 00000100:00100000:1.0:1769074932.300831:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:2417:x1855007616198784:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 478us (673us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074932.300837:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 269 00000100:00100000:0.0:1769074932.323297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.324039:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616198912 00000100:00100000:1.0:1769074932.324050:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616198912 00000100:00100000:1.0:1769074932.324117:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9740 00000100:00100000:1.0:1769074932.324129:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67800:x1855007616198912:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074932.324149:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.324170:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bdfe expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.324244:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.324259:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324269:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324281:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.324287:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324291:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324355:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324363:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324368:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324374:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324379:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.324383:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324390:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324402:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.324405:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.324409:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324415:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec5d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324428:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324434:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324440:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324444:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.324446:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324454:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324461:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.324463:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.324466:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324471:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec5db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.324513:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5cd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdfe expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.324522:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.324525:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.324565:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec5cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bdfe expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.324577:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074932.324638:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67800:x1855007616198912:12345-192.168.204.32@tcp:101:bash.0 Request processed in 511us (1350us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.325115:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9740 00000100:00100000:0.0:1769074932.336264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.336363:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199040 00000100:00100000:2.0:1769074932.336375:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199040 00000100:00100000:2.0:1769074932.336439:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9741 00000100:00100000:2.0:1769074932.336449:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67801:x1855007616199040:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.336468:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.336504:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec5e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be05 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.336607:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.336621:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336632:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336659:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.336666:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336672:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336724:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336731:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336737:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336747:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.336751:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336758:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336769:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.336772:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.336777:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336783:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec5e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336795:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336800:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336806:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336811:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.336813:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336818:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336824:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.336826:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.336829:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336836:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec5f0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.336868:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec5e2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be05 expref: 412 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.336878:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.336881:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.336884:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec5e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be05 expref: 412 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.336893:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc 0) 00000100:00100000:2.0:1769074932.336945:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67801:x1855007616199040:12345-192.168.204.32@tcp:101:rm.0 Request processed in 498us (692us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.336952:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9741 00000100:00100000:0.0:1769074932.339987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.340097:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199168 00000100:00100000:3.0:1769074932.340109:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199168 00000100:00100000:3.0:1769074932.340176:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 270 00000100:00100000:3.0:1769074932.340187:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:2419:x1855007616199168:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074932.340231:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.340252:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec5f7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be0c expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.340311:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074932.340325:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340337:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340359:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074932.340366:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340372:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340423:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340431:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340438:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340443:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.340448:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340455:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340466:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.340470:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.340474:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340479:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8000/0x557988ac98fec5fe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340506:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340513:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340518:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340523:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.340526:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340572:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340579:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec2ff00) 00010000:00010000:3.0:1769074932.340582:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.340584:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340589:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec605 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.340617:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec5f7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be0c expref: 412 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.340625:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.340627:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074932.340629:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b9a00/0x557988ac98fec5f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be0c expref: 412 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.340635:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc -2) 00000100:00100000:3.0:1769074932.340689:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:2419:x1855007616199168:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 504us (712us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074932.340693:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 270 00000100:00100000:0.0:1769074932.345651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.345754:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199296 00000100:00100000:1.0:1769074932.345765:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199296 00000100:00100000:1.0:1769074932.345825:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9742 00000100:00100000:1.0:1769074932.345834:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67801:x1855007616199296:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074932.345854:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.345875:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec60c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be13 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.345948:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.345962:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.345972:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.345987:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.345993:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.345998:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346058:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346065:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346071:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346077:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346083:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.346087:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346094:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346106:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.346109:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.346113:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346119:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec613 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346131:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346136:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346141:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346145:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.346148:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346153:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346159:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.346161:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.346164:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346169:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec61a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.346205:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec60c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be13 expref: 412 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.346215:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.346217:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.346221:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec60c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be13 expref: 412 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.346231:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074932.346292:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67801:x1855007616199296:12345-192.168.204.32@tcp:101:rm.0 Request processed in 458us (651us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.346299:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9742 00000100:00100000:3.0:1769074932.361088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.361201:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199424 00000100:00100000:2.0:1769074932.361211:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199424 00000100:00100000:2.0:1769074932.361271:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9743 00000100:00100000:2.0:1769074932.361280:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67802:x1855007616199424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.361299:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.361320:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec621 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be1a expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.361393:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.361409:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361421:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361433:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.361438:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361444:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361504:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361512:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361519:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361525:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.361570:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361578:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361589:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.361592:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.361597:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361602:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec628 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361616:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361622:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361627:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361632:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.361635:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361640:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361647:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.361649:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.361652:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361657:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec62f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.361688:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec621 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be1a expref: 412 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.361699:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.361701:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.361704:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec621 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be1a expref: 412 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.361718:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc 0) 00000100:00100000:2.0:1769074932.361771:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67802:x1855007616199424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 493us (694us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.361779:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9743 00000100:00100000:0.0:1769074932.368750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.369048:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199552 00000100:00100000:1.0:1769074932.369060:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199552 00000100:00100000:1.0:1769074932.369163:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9744 00000100:00100000:1.0:1769074932.369173:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67802:x1855007616199552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.369206:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.369227:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec636 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be21 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.369296:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.369311:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369321:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369339:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.369346:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369352:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369405:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369413:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369418:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369424:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369430:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.369435:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369443:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369455:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.369458:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.369462:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369468:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec63d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369480:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369486:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369943:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369951:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48ce00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.369954:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369960:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369969:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff91604f4f9200) 00010000:00010000:1.0:1769074932.369972:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.369975:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.369980:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec644 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.370017:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec636 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be21 expref: 412 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.370026:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.370039:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.370043:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec636 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be21 expref: 412 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.370057:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074932.370129:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67802:x1855007616199552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 956us (1390us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.370137:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9744 00000100:00100000:3.0:1769074932.374962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.375141:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199808 00000100:00100000:1.0:1769074932.375150:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199808 00000100:00100000:1.0:1769074932.375212:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9745 00000100:00100000:1.0:1769074932.375222:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67802:x1855007616199808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.375241:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.375261:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec64b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be28 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.375382:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.375397:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.375408:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.375422:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.375428:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.375433:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:1.0:1769074932.376142:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd0:0x0], index 0: 0 00010000:00010000:1.0:1769074932.376845:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fec660 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.376861:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fec660 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.376870:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fec660 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377330:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377339:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377344:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377351:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377356:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.377360:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377367:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377379:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.377383:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.377388:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377399:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec652 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:1.0:1769074932.377412:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000699d3f6a reply state 00000000111b16a4 transno 4294969138 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377422:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.377428:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff91604f4f9800) 00010000:00010000:1.0:1769074932.377431:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074932.377434:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074932.377472:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec64b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be28 expref: 414 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.377488:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e094800/0x557988ac98fec660 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be28 expref: 413 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.378130:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1aa:0x0].0x0 (ffff91604f4f9900) 00010000:00010000:1.0:1769074932.378132:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074932.378135:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e094800, rc 0) 00000100:00100000:1.0:1769074932.378439:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67802:x1855007616199808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3215us (3483us total) trans 4294969138 rc 0/0 00000100:00100000:1.0:1769074932.378448:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9745 00000100:00100000:0.0:1769074932.383942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.384022:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616199936 00000100:00100000:1.0:1769074932.384042:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616199936 00000100:00100000:1.0:1769074932.384099:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2825 00000100:00100000:1.0:1769074932.384108:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616199936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.384125:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.384151:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be2f expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074932.384174:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074932.384202:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.384205:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.384214:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 218 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.384229:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 218 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.384241:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074932.384305:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616199936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 198us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.384313:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2825 00000100:00100000:0.0:1769074932.389427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.389514:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200064 00000100:00100000:3.0:1769074932.389525:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200064 00000100:00100000:3.0:1769074932.389614:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2826 00000100:00100000:3.0:1769074932.389624:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:67802:x1855007616200064:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.389641:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.389660:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be36 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.389692:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 219 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.389700:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.389703:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.389707:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be36 expref: 219 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.389739:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 219 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.389753:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 219 pid: 25313 timeout: 2021 lvb_type: 1 00000100:00100000:3.0:1769074932.389766:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916042a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626641408:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074932.389863:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617bb8f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074932.394210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.394313:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200192 00000100:00100000:1.0:1769074932.394324:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200192 00000100:00100000:3.0:1769074932.394397:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916042a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626641408:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074932.394398:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 220 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:3.0:1769074932.394427:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be36 expref: 220 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.394441:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1940 00010000:00010000:3.0:1769074932.394444:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b9a00, rc 0) 00000100:00100000:1.0:1769074932.394449:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616200192:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074932.394465:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074932.394485:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 220 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.394503:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 220 pid: 25313 timeout: 2021 lvb_type: 1 00000100:00100000:3.0:1769074932.394507:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:67802:x1855007616200064:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4885us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.394514:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2826 00010000:00010000:1.0:1769074932.394526:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e095600/0x557988ac98fec66e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be2f expref: 219 pid: 25313 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.394566:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.394568:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.394576:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be36 expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.394586:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be36 expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.394620:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604d9b9a00/0x557988ac98fec675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be36 expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.394632:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626641536:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074932.394684:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.398693:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626641536:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074932.398720:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074932.398771:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616200192:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4321us (4569us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.398782:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1940 00000100:00100000:2.0:1769074932.402884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.403265:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200448 00000100:00100000:1.0:1769074932.403278:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200448 00000100:00100000:1.0:1769074932.403338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1925 00000100:00100000:1.0:1769074932.403347:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67802:x1855007616200448:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074932.403694:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67802:x1855007616200448:12345-192.168.204.32@tcp:35:cp.0 Request processed in 346us (818us total) trans 4294969139 rc 0/0 00000100:00100000:1.0:1769074932.403702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1925 00000100:00100000:0.0:1769074932.461973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.462208:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200576 00000100:00100000:1.0:1769074932.462219:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200576 00000100:00100000:1.0:1769074932.462289:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9746 00000100:00100000:1.0:1769074932.462299:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67805:x1855007616200576:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074932.462320:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.462341:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec67c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be3d expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.462424:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.462439:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462449:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462466:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.462473:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462479:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462592:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462600:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462606:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462612:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462617:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.462621:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462627:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462650:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.462654:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.462659:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462664:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec683 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462677:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462683:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462688:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462694:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.462697:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462703:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462710:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604ec3c000) 00010000:00010000:1.0:1769074932.462712:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.462715:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462720:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec68a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.462749:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec67c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be3d expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.462759:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.462762:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.462766:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec67c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be3d expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.462775:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074932.462831:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67805:x1855007616200576:12345-192.168.204.32@tcp:101:bash.0 Request processed in 534us (866us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.462839:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9746 00000100:00100000:0.0:1769074932.493412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.493564:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200704 00000100:00100000:2.0:1769074932.493575:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200704 00000100:00100000:2.0:1769074932.493648:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9747 00000100:00100000:2.0:1769074932.493659:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67806:x1855007616200704:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.493684:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.493704:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec691 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be44 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.493773:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.493789:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.493800:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.493815:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.493821:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.493826:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.493882:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495133:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495146:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495152:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.495158:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495168:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495183:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.495186:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.495191:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495198:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec698 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495215:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495220:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495224:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495228:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.495231:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495236:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495243:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.495245:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.495247:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495252:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec69f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.495295:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec691 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be44 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.495304:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.495305:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.495309:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec691 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be44 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.495317:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422400, rc 0) 00000100:00100000:2.0:1769074932.495413:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67806:x1855007616200704:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1755us (2008us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.495422:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9747 00000100:00100000:0.0:1769074932.499016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.500975:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200832 00000100:00100000:1.0:1769074932.500991:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200832 00000100:00100000:1.0:1769074932.501110:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 271 00000100:00100000:1.0:1769074932.501121:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:2420:x1855007616200832:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074932.501160:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.501180:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be4b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.501248:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.501262:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501274:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501287:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.501293:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501299:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501363:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501371:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501376:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501382:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.501387:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501394:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501405:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.501408:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.501412:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501418:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501429:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501435:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501441:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501446:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.501448:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501453:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501459:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff91604ec3c000) 00010000:00010000:1.0:1769074932.501461:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.501464:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501474:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.501499:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6a6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be4b expref: 416 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.501508:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.501511:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074932.501514:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be4b expref: 416 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.501522:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297e00, rc -2) 00000100:00100000:1.0:1769074932.501733:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:2420:x1855007616200832:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 613us (2729us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074932.501741:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 271 00000100:00100000:0.0:1769074932.505867:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.505972:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616200960 00000100:00100000:2.0:1769074932.505983:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616200960 00000100:00100000:2.0:1769074932.506049:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9748 00000100:00100000:2.0:1769074932.506058:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67806:x1855007616200960:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.506080:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.506102:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be52 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.506167:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.506181:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506203:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506217:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.506224:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506229:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506281:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506288:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506294:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506300:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.506304:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506315:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506326:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.506329:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.506334:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506339:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506353:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506359:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506364:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506369:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.506371:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506378:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506385:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.506388:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.506390:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506395:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.506425:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6bb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be52 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.506434:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.506436:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.506440:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be52 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.506447:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422400, rc 0) 00000100:00100000:2.0:1769074932.506506:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67806:x1855007616200960:12345-192.168.204.32@tcp:101:rm.0 Request processed in 449us (649us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.506515:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9748 00000100:00100000:0.0:1769074932.529792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.529881:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201088 00000100:00100000:1.0:1769074932.529898:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201088 00000100:00100000:1.0:1769074932.529962:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9749 00000100:00100000:1.0:1769074932.529973:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67807:x1855007616201088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.529993:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.530014:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be59 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.530098:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.530112:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530126:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530140:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.530146:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530153:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530221:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530229:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530234:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530240:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530245:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.530249:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530255:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530267:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.530270:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.530274:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530280:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec6d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530293:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530299:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530304:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530308:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.530311:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530315:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530321:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604ec3c000) 00010000:00010000:1.0:1769074932.530323:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.530325:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530331:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.530361:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6d0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be59 expref: 416 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.530369:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.530372:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.530375:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec6d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be59 expref: 416 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.530383:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074932.530449:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67807:x1855007616201088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 476us (664us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.530456:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9749 00000100:00100000:0.0:1769074932.538851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.539055:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201216 00000100:00100000:2.0:1769074932.539067:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201216 00000100:00100000:2.0:1769074932.539128:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9750 00000100:00100000:2.0:1769074932.539138:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67807:x1855007616201216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.539158:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.539182:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be60 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.539257:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.539270:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539281:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539297:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.539302:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539308:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539357:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539364:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539370:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539375:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.539379:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539386:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539397:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.539400:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.539404:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539409:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec6ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539423:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539429:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539433:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539437:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.539440:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539445:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539450:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.539452:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.539454:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539459:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fec6f3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.539488:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6e5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be60 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.539510:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.539512:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.539516:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fec6e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be60 expref: 416 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.539524:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422400, rc 0) 00000100:00100000:2.0:1769074932.539623:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67807:x1855007616201216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 486us (783us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.539630:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9750 00000100:00100000:0.0:1769074932.545993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.546239:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201472 00000100:00100000:1.0:1769074932.546250:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201472 00000100:00100000:1.0:1769074932.546312:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9751 00000100:00100000:1.0:1769074932.546321:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67807:x1855007616201472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.546342:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.546361:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6fa lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be67 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.546475:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.546501:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.546512:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.546528:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.546574:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.546580:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:1.0:1769074932.546858:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd1:0x0], index 1: 0 00010000:00010000:1.0:1769074932.547020:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec70f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.547039:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec70f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547046:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec70f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547077:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547084:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547090:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547096:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547101:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.547105:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547111:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547123:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.547126:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.547130:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547139:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec701 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:1.0:1769074932.547152:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d807bf0a reply state 00000000195afa9e transno 4294969140 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547162:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.547168:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604ec3c000) 00010000:00010000:1.0:1769074932.547170:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074932.547173:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074932.547201:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec6fa lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be67 expref: 418 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.547216:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c000/0x557988ac98fec70f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be67 expref: 417 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.547222:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ab:0x0].0x0 (ffff91604ec3c300) 00010000:00010000:1.0:1769074932.547224:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074932.547227:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c000, rc 0) 00000100:00100000:1.0:1769074932.547283:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67807:x1855007616201472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 962us (1298us total) trans 4294969140 rc 0/0 00000100:00100000:1.0:1769074932.547291:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9751 00000100:00100000:0.0:1769074932.553212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.553691:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201600 00000100:00100000:3.0:1769074932.553702:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201600 00000100:00100000:3.0:1769074932.553752:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2827 00000100:00100000:3.0:1769074932.553761:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2419:x1855007616201600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.553779:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.553800:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be6e expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074932.553827:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074932.553845:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.553847:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.553854:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.553870:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 217 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.553884:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074932.554139:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616201600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 378us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.554146:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2827 00000100:00100000:0.0:1769074932.557856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.558018:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201728 00000100:00100000:3.0:1769074932.558037:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201728 00000100:00100000:3.0:1769074932.558088:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2828 00000100:00100000:3.0:1769074932.558097:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:67807:x1855007616201728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.558115:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.558131:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be75 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.558158:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.558166:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.558168:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.558172:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be75 expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.558210:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.558224:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 218 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:3.0:1769074932.558237:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916042a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626641664:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074932.558759:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91617bb8f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074932.561913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.562112:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616201856 00000100:00100000:1.0:1769074932.562123:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616201856 00010000:00010000:1.0:1769074932.562179:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 219 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:1.0:1769074932.562237:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1941 00000100:00100000:1.0:1769074932.562246:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616201856:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074932.562262:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074932.562283:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 219 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.562299:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 219 pid: 24564 timeout: 2021 lvb_type: 1 00010000:00010000:1.0:1769074932.562324:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.562326:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.562335:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be75 expref: 219 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.562344:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be75 expref: 219 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.562381:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be75 expref: 219 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.562394:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626641792:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074932.562489:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f180 going to sleep for 11 seconds 00010000:00010000:3.0:1769074932.562966:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8400/0x557988ac98fec71d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be6e expref: 219 pid: 24564 timeout: 2021 lvb_type: 1 00000100:00100000:3.0:1769074932.562981:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916042a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626641664:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074932.563006:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604d9b8000/0x557988ac98fec724 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be75 expref: 218 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.563018:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8000, rc 0) 00000100:00100000:3.0:1769074932.563071:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:67807:x1855007616201728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4974us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.563079:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2828 00000100:00100000:0.0:1769074932.568387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.568486:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202112 00000100:00100000:1.0:1769074932.568507:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202112 00000100:00100000:1.0:1769074932.568597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1926 00000100:00100000:1.0:1769074932.568607:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618103f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+418:67807:x1855007616202112:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074932.568910:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618103f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67807:x1855007616202112:12345-192.168.204.32@tcp:35:cp.0 Request processed in 303us (530us total) trans 4294969141 rc 0/0 00000100:00100000:1.0:1769074932.568918:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1926 00000100:00100000:0.0:1769074932.574520:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626641792:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074932.574589:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074932.574657:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616201856:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12410us (12752us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074932.574669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1941 00000100:00100000:2.0:1769074932.627201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.627418:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202240 00000100:00100000:3.0:1769074932.627430:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202240 00000100:00100000:3.0:1769074932.627512:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9752 00000100:00100000:3.0:1769074932.627522:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67811:x1855007616202240:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074932.627802:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.627826:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec72b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be7c expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.627997:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.628010:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628021:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628047:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.628053:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628060:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628117:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628124:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628130:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628135:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.628139:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628149:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628160:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.628162:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.628167:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628172:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec732 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628183:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628282:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628288:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628293:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.628297:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628304:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628315:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff91604ec2f300) 00010000:00010000:3.0:1769074932.628317:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.628319:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628324:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec739 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.628356:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec72b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be7c expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.628366:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.628368:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.628371:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec72b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be7c expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.628380:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074932.628452:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67811:x1855007616202240:12345-192.168.204.32@tcp:101:bash.0 Request processed in 931us (1270us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074932.628460:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9752 00000100:00100000:3.0:1769074932.645292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.645503:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202368 00000100:00100000:2.0:1769074932.645513:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202368 00000100:00100000:2.0:1769074932.645604:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9753 00000100:00100000:2.0:1769074932.645614:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67812:x1855007616202368:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.645645:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.645666:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec740 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be83 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.645729:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.645743:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645756:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645770:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.645777:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645783:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645829:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645837:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645845:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645850:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.645854:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645861:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645872:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.645874:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.645879:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645892:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec747 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645906:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645911:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645916:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645920:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.645923:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645928:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645938:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff9161748d2400) 00010000:00010000:2.0:1769074932.645940:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.645943:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645948:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec74e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.645977:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec740 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be83 expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.645987:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.645989:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.645992:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec740 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be83 expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.646000:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:2.0:1769074932.646593:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67812:x1855007616202368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 977us (1307us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.646602:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9753 00000100:00100000:1.0:1769074932.653516:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.653581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.653869:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202624 00000100:00100000:2.0:1769074932.653879:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202624 00000100:00100000:2.0:1769074932.653937:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9754 00000100:00100000:2.0:1769074932.653946:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67812:x1855007616202624:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.653967:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.653988:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec755 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be91 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.654065:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.654079:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654090:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654103:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.654110:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654116:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654164:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654171:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654176:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654182:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.654192:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654200:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654214:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.654217:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.654221:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654227:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec75c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654240:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654246:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654251:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654256:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.654259:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654265:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654270:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff9161748d2c00) 00010000:00010000:2.0:1769074932.654272:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.654274:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654279:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec763 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.654306:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec755 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be91 expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.654316:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.654318:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.654321:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec755 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be91 expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.654330:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422800, rc 0) 00000100:00100000:2.0:1769074932.654386:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67812:x1855007616202624:12345-192.168.204.32@tcp:101:rm.0 Request processed in 440us (893us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.654393:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9754 00000100:00100000:3.0:1769074932.659405:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202496 00000100:00100000:3.0:1769074932.659421:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202496 00000100:00100000:3.0:1769074932.659501:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 272 00000100:00100000:3.0:1769074932.659511:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:2419:x1855007616202496:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074932.661324:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.661348:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec76a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be8a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.661408:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074932.661422:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.661433:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.661451:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074932.661457:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.661462:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662762:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662776:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662782:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662787:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.662791:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662798:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662813:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.662816:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.662820:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662825:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec771 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662839:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662846:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662850:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662855:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.662858:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662863:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662870:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff91604ec2f300) 00010000:00010000:3.0:1769074932.662872:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.662875:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.662880:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec778 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074932.663323:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec76a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be8a expref: 420 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.663334:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.663337:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074932.663340:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec76a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be8a expref: 420 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.663349:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc -2) 00000100:00100000:3.0:1769074932.663508:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:2419:x1855007616202496:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 3995us (9924us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074932.663519:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 272 00000100:00100000:1.0:1769074932.682591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.682683:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202752 00000100:00100000:0.0:1769074932.682694:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202752 00000100:00100000:0.0:1769074932.682756:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9755 00000100:00100000:0.0:1769074932.682766:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67813:x1855007616202752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074932.682788:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.682809:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec77f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be98 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.682872:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.682896:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682907:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682920:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.682927:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682932:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682981:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682988:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.682994:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683000:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683006:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.683009:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683016:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683041:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.683044:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.683049:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683054:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec786 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683067:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683073:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683079:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683084:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.683087:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683092:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683098:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff916052ae5f00) 00010000:00010000:0.0:1769074932.683100:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.683103:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683108:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fec78d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.683138:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec77f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be98 expref: 420 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.683148:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.683150:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.683154:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fec77f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be98 expref: 420 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.683164:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074932.683238:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67813:x1855007616202752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 474us (656us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074932.683247:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9755 00000100:00100000:0.0:1769074932.687587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.687685:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616202880 00000100:00100000:2.0:1769074932.687697:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616202880 00000100:00100000:2.0:1769074932.687756:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9756 00000100:00100000:2.0:1769074932.687765:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67813:x1855007616202880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.687785:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.687807:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec794 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2be9f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.687869:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.687884:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687903:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687917:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.687929:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687935:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687985:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687992:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.687999:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688005:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.688009:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688015:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688035:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.688039:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.688044:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688049:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fec79b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688063:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688068:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688073:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688077:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.688079:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688084:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688090:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff9161748d2c00) 00010000:00010000:2.0:1769074932.688092:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.688094:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688098:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec7a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.688126:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec794 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be9f expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.688134:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.688136:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.688139:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec794 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2be9f expref: 420 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.688148:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422800, rc 0) 00000100:00100000:2.0:1769074932.688204:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67813:x1855007616202880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 441us (627us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.688211:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9756 00000100:00100000:3.0:1769074932.692323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.692423:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203136 00000100:00100000:0.0:1769074932.692434:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203136 00000100:00100000:0.0:1769074932.692744:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9757 00000100:00100000:1.0:1769074932.692815:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67813:x1855007616203136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.692838:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.692858:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec7a9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bea6 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.692983:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.692997:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693007:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693021:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.693038:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693044:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:1.0:1769074932.693332:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd1:0x0], index 0: 0 00010000:00010000:1.0:1769074932.693474:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec7be lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.693483:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec7be lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693502:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec7be lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693559:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693567:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693573:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693580:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693586:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.693590:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693597:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693608:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.693612:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.693616:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693622:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7b0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:1.0:1769074932.693641:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000841ce8d3 reply state 00000000e63ca7df transno 4294969142 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693652:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.693658:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff91604ec3c500) 00010000:00010000:1.0:1769074932.693660:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074932.693662:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074932.693689:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48ce00/0x557988ac98fec7a9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bea6 expref: 422 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.693702:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297e00/0x557988ac98fec7be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bea6 expref: 421 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.693710:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ac:0x0].0x0 (ffff91604ec3c900) 00010000:00010000:1.0:1769074932.693712:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074932.693715:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e297e00, rc 0) 00000100:00100000:1.0:1769074932.693777:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67813:x1855007616203136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1024us (1464us total) trans 4294969142 rc 0/0 00000100:00100000:0.0:1769074932.700506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.700665:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203264 00000100:00100000:3.0:1769074932.700676:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203264 00000100:00100000:3.0:1769074932.700730:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2829 00000100:00100000:3.0:1769074932.700739:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616203264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.700756:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.700775:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bead expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074932.700796:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074932.700813:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.700815:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.700822:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 219 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.700839:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 219 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.700851:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f16da00, rc 0) 00000100:00100000:3.0:1769074932.700918:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616203264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 178us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.700925:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2829 00000100:00100000:1.0:1769074932.702471:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9757 00000100:00100000:0.0:1769074932.707213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.707300:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203392 00000100:00100000:1.0:1769074932.707310:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203392 00000100:00100000:1.0:1769074932.707364:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2830 00000100:00100000:1.0:1769074932.707376:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:67813:x1855007616203392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.707394:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.707413:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2beb4 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.707455:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.707463:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.707465:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.707470:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beb4 expref: 220 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.707505:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.707519:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074932.707565:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626641920:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074932.707663:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f780 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.711102:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626641920:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074932.711142:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beb4 expref: 220 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.711164:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48ce00, rc 0) 00000100:00100000:1.0:1769074932.711243:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:67813:x1855007616203392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3869us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.711251:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2830 00000100:00100000:0.0:1769074932.714518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.715515:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203520 00000100:00100000:1.0:1769074932.715527:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203520 00010000:00010000:1.0:1769074932.715605:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074932.715718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1942 00000100:00100000:1.0:1769074932.715728:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616203520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074932.715744:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074932.715765:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074932.715780:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074932.715804:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f16da00/0x557988ac98fec7cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bead expref: 220 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074932.715820:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.715822:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.715829:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beb4 expref: 219 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.715839:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beb4 expref: 219 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.715877:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48ce00/0x557988ac98fec7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beb4 expref: 219 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074932.715989:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626642048:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074932.716137:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f780 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.719390:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626642048:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074932.719414:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074932.719507:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616203520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3779us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.719518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1942 00000100:00100000:3.0:1769074932.725044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.725351:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203776 00000100:00100000:0.0:1769074932.725361:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203776 00000100:00100000:0.0:1769074932.725418:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1927 00000100:00100000:0.0:1769074932.725428:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+422:67813:x1855007616203776:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074932.725773:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67813:x1855007616203776:12345-192.168.204.32@tcp:35:cp.0 Request processed in 345us (746us total) trans 4294969143 rc 0/0 00000100:00100000:0.0:1769074932.725782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1927 00000100:00100000:0.0:1769074932.772991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.773204:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616203904 00000100:00100000:1.0:1769074932.773216:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616203904 00000100:00100000:1.0:1769074932.773284:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9758 00000100:00100000:1.0:1769074932.773294:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67816:x1855007616203904:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074932.773315:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.773337:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bebb expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.773406:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.773421:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773433:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773448:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.773454:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773460:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773527:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773571:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773578:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773583:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773589:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.773593:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773600:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773612:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.773614:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.773619:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773625:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec7e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773638:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773643:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773649:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773654:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.773657:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773663:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773670:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604ec3c600) 00010000:00010000:1.0:1769074932.773672:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.773675:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773680:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec7e8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.773708:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7da lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bebb expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.773716:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.773719:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.773722:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec7da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bebb expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.773731:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074932.773793:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67816:x1855007616203904:12345-192.168.204.32@tcp:101:bash.0 Request processed in 500us (812us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.773801:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9758 00000100:00100000:2.0:1769074932.789595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.789859:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204032 00000100:00100000:3.0:1769074932.789870:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204032 00000100:00100000:3.0:1769074932.789945:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9759 00000100:00100000:3.0:1769074932.789954:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67817:x1855007616204032:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074932.789979:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.790002:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec7ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bec2 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.790084:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.790098:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790110:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790125:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.790132:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790138:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790441:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790449:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790455:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790461:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.790465:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790473:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790485:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.790488:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.790504:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790510:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec7f6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790523:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790570:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790577:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790582:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.790585:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790591:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790598:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604ec2fe00) 00010000:00010000:3.0:1769074932.790600:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.790603:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790613:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec7fd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.790648:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec7ef lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bec2 expref: 424 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.790658:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.790661:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.790665:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec7ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bec2 expref: 424 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.790673:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:3.0:1769074932.790782:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67817:x1855007616204032:12345-192.168.204.32@tcp:101:rm.0 Request processed in 827us (1195us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074932.790790:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9759 00000100:00100000:0.0:1769074932.800929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.800968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.801044:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204160 00000100:00100000:3.0:1769074932.801054:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204160 00000100:00100000:3.0:1769074932.801116:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9760 00000100:00100000:3.0:1769074932.801125:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67817:x1855007616204160:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074932.801145:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.801164:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec804 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bec9 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.801236:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.801251:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801266:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801281:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:3.0:1769074932.801287:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801292:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801342:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801349:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801356:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801361:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.801365:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801372:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801383:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.801386:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.801391:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801397:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec80b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801409:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801415:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801421:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801426:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.801428:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801433:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801439:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604ec2f900) 00010000:00010000:3.0:1769074932.801442:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.801444:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801449:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec812 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074932.801478:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec804 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bec9 expref: 424 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.801487:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.801490:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.801493:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec804 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bec9 expref: 424 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.801507:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:3.0:1769074932.801599:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67817:x1855007616204160:12345-192.168.204.32@tcp:101:rm.0 Request processed in 474us (678us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074932.801607:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9760 00000100:00100000:1.0:1769074932.802427:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204288 00000100:00100000:1.0:1769074932.802435:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204288 00000100:00100000:1.0:1769074932.802481:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 273 00000100:00100000:1.0:1769074932.802489:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:2419:x1855007616204288:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074932.802516:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.802558:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec819 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bed0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.802606:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.802618:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802626:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802650:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074932.802657:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802664:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802706:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802713:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802719:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802725:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.802729:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802736:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802747:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.802750:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.802754:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802761:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec820 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802772:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802778:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802785:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802789:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.802792:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802797:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802802:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604ec3c600) 00010000:00010000:1.0:1769074932.802805:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.802808:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802817:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec827 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074932.802840:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec819 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bed0 expref: 424 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.802848:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.802851:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074932.802854:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec819 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bed0 expref: 424 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.802862:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc -2) 00000100:00100000:1.0:1769074932.802928:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:2419:x1855007616204288:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 439us (1958us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074932.802936:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 273 00000100:00100000:0.0:1769074932.823248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.823371:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204416 00000100:00100000:2.0:1769074932.823383:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204416 00000100:00100000:2.0:1769074932.823484:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9761 00000100:00100000:2.0:1769074932.823508:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67818:x1855007616204416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.823562:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.823583:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec82e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bed7 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.823661:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.823676:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823686:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823700:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.823707:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823713:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823764:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823771:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823776:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823782:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823787:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.823790:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823798:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823809:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.823812:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.823817:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823823:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fec835 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823836:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823842:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823847:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823852:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.823854:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823860:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823870:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff9161748d2c00) 00010000:00010000:2.0:1769074932.823872:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.823875:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823880:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fec83c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.823916:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec82e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bed7 expref: 424 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.823926:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.823928:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.823932:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fec82e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bed7 expref: 424 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.823941:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:2.0:1769074932.824005:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67818:x1855007616204416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 512us (768us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.824012:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9761 00000100:00100000:1.0:1769074932.827465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.828100:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204544 00000100:00100000:2.0:1769074932.828110:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204544 00000100:00100000:2.0:1769074932.828212:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9762 00000100:00100000:2.0:1769074932.828222:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67818:x1855007616204544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.828242:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.828264:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec843 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bede expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.828338:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.828354:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828366:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828380:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.828387:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828393:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828458:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828466:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828473:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828478:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828484:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.828488:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828514:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828525:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.828528:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.828553:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828560:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec84a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828575:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828581:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828587:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828591:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.828594:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828599:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828607:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff9161748d2400) 00010000:00010000:2.0:1769074932.828610:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.828613:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828618:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec851 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.828826:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec843 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bede expref: 424 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.828837:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.828839:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.828842:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec843 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bede expref: 424 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.828850:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:2.0:1769074932.828925:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67818:x1855007616204544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 704us (1469us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.828932:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9762 00000100:00100000:0.0:1769074932.833050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.833134:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204800 00000100:00100000:2.0:1769074932.833144:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204800 00000100:00100000:2.0:1769074932.833232:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9763 00000100:00100000:2.0:1769074932.833242:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67818:x1855007616204800:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074932.833262:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.833282:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fec858 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bee5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.833398:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.833411:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.833422:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.833461:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.833469:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.833475:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074932.834159:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd2:0x0], index 1: 0 00010000:00010000:2.0:1769074932.834318:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec86d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074932.834331:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec86d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834340:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec86d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834373:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834380:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834386:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834393:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834398:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.834402:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834410:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834422:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.834425:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.834430:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834436:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec85f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074932.834450:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000010e94b1 reply state 000000006eb24643 transno 4294969144 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834460:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074932.834465:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604e58ca00) 00010000:00010000:2.0:1769074932.834467:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074932.834470:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074932.835386:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fec858 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bee5 expref: 426 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.835405:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422800/0x557988ac98fec86d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bee5 expref: 425 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.835412:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ad:0x0].0x0 (ffff91604e58c400) 00010000:00010000:2.0:1769074932.835414:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074932.835417:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422800, rc 0) 00000100:00100000:2.0:1769074932.835490:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67818:x1855007616204800:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2249us (2448us total) trans 4294969144 rc 0/0 00000100:00100000:2.0:1769074932.835513:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9763 00000100:00100000:1.0:1769074932.835656:0:9989:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434adc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1855007626642176:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1769074932.835707:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074932.835759:0:9989:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074932.835781:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626642176 00000100:00100000:1.0:1769074932.835787:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626642176 00000100:00100000:1.0:1769074932.835838:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:1.0:1769074932.835846:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:9989:x1855007626642176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1769074932.835895:0:25313:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 226 00000100:00100000:2.0:1769074932.844778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074932.844863:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616204928 00000100:00100000:3.0:1769074932.844876:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616204928 00000100:00100000:3.0:1769074932.844941:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2832 00000100:00100000:3.0:1769074932.844952:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616204928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074932.844970:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.844992:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2beec expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074932.845017:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074932.845051:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.845054:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074932.845063:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.845081:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 218 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074932.845095:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074932.845156:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616204928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 206us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074932.845164:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2832 00000100:00100000:2.0:1769074932.849958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.850139:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205056 00000100:00100000:0.0:1769074932.850150:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205056 00000100:00100000:0.0:1769074932.850215:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2833 00000100:00100000:0.0:1769074932.850225:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:67818:x1855007616205056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074932.850242:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.850264:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bef3 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.850295:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074932.850303:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074932.850305:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074932.850309:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bef3 expref: 219 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.850342:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074932.850357:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 2022 lvb_type: 1 00000100:00100000:0.0:1769074932.850370:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626642304:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074932.850465:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074932.861498:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626642304:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074932.861568:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bef3 expref: 219 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.861589:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb800, rc 0) 00000100:00100000:0.0:1769074932.861656:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:67818:x1855007616205056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11431us (11708us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074932.861664:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2833 00000100:00100000:2.0:1769074932.876865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.876904:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205184 00000100:00100000:0.0:1769074932.876915:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205184 00010000:00010000:0.0:1769074932.876977:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 2022 lvb_type: 1 00000100:00100000:0.0:1769074932.877030:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1943 00000100:00100000:0.0:1769074932.877039:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616205184:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074932.877056:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074932.877076:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074932.877089:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074932.877113:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec87b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2beec expref: 219 pid: 24564 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074932.877130:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074932.877131:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074932.877140:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bef3 expref: 218 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.877150:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bef3 expref: 218 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.877197:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f4fb800/0x557988ac98fec882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bef3 expref: 218 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074932.877211:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626642432:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074932.877297:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074932.882655:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626642432:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074932.882683:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074932.882747:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616205184:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5708us (5890us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074932.882758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1943 00000100:00100000:1.0:1769074932.883853:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:9989:x1855007626642176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48004us (48142us total) trans 4294967875 rc 0/0 00000100:00100000:1.0:1769074932.883863:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1769074932.886278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.886373:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205440 00000100:00100000:1.0:1769074932.886383:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205440 00000100:00100000:1.0:1769074932.886434:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1928 00000100:00100000:1.0:1769074932.886442:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:67818:x1855007616205440:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074932.886781:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67818:x1855007616205440:12345-192.168.204.32@tcp:35:cp.0 Request processed in 338us (511us total) trans 4294969145 rc 0/0 00000100:00100000:1.0:1769074932.886789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1928 00000100:00100000:2.0:1769074932.890272:0:9989:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434adc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1855007626642176:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1769074932.890293:0:9989:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xd2:0x0]-[0x2c0000400:0x101:0x0] 00010000:00010000:2.0:1769074932.915834:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1769074932.924006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.924123:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205568 00000100:00100000:1.0:1769074932.924133:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205568 00000100:00100000:1.0:1769074932.924198:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9764 00000100:00100000:1.0:1769074932.924208:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67821:x1855007616205568:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074932.924228:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.924250:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec889 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2befa expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.924316:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.924330:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924341:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924356:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074932.924363:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924369:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924428:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924435:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924441:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924448:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924454:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.924458:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924464:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924476:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.924479:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.924484:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924489:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec890 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924884:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924891:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924895:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924901:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48d200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.924904:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924910:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924918:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604ec3c600) 00010000:00010000:1.0:1769074932.924921:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.924924:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924929:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec897 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074932.924968:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec889 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2befa expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.924979:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.924982:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.924987:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec889 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2befa expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.924997:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f16da00, rc 0) 00000100:00100000:0.0:1769074932.926160:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67821:x1855007616205568:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1946us (2157us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074932.926170:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9764 00000100:00100000:1.0:1769074932.942104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.942225:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.944397:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205696 00000100:00100000:0.0:1769074932.944412:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205696 00000100:00100000:3.0:1769074932.944898:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205824 00000100:00100000:3.0:1769074932.944904:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205824 00000100:00100000:3.0:1769074932.944954:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 274 00000100:00100000:3.0:1769074932.944965:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2419:x1855007616205824:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074932.945005:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074932.945035:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec89e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf08 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.945093:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074932.945108:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945118:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945134:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074932.945141:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945148:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945212:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945219:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945226:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945232:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.945236:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945243:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945255:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.945259:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.945263:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945268:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec8a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945281:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945286:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945292:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945297:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074932.945300:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945305:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945312:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec2fa00) 00010000:00010000:3.0:1769074932.945315:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074932.945318:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945323:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec8ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074932.945351:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec89e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf08 expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.945360:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074932.945362:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074932.945366:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec89e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf08 expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074932.945375:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc -2) 00000100:00100000:3.0:1769074932.945450:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2419:x1855007616205824:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 487us (3224us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074932.945458:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 274 00000100:00100000:0.0:1769074932.947516:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9765 00000100:00100000:0.0:1769074932.947556:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67822:x1855007616205696:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074932.947579:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.947599:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf01 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.947926:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.947941:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.947951:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.947966:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.947972:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.947978:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948039:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948047:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948053:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948059:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948065:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.948069:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948075:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948086:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.948089:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.948093:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948100:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec8ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948115:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948120:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948126:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948131:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.948134:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948139:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948144:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff916052ae5f00) 00010000:00010000:0.0:1769074932.948146:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.948148:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948154:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.948959:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8b3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf01 expref: 428 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.948974:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.948976:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.948980:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf01 expref: 428 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.948989:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fba00, rc 0) 00000100:00100000:0.0:1769074932.949072:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67822:x1855007616205696:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1543us (6977us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074932.949081:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9765 00000100:00100000:1.0:1769074932.952410:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074932.953391:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616205952 00000100:00100000:2.0:1769074932.953403:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616205952 00000100:00100000:2.0:1769074932.953467:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9766 00000100:00100000:2.0:1769074932.953477:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67822:x1855007616205952:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074932.953730:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074932.953754:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fec8c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf0f expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.953817:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.953832:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953844:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953858:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:2.0:1769074932.953865:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953872:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953921:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953928:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953934:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953939:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.953943:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953950:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953961:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.953964:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.953968:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953973:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec8cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953987:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953992:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.953997:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.954002:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074932.954004:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.954010:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.954017:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604e58ce00) 00010000:00010000:2.0:1769074932.954031:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.954034:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.954039:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec8d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:2.0:1769074932.954069:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fec8c8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf0f expref: 428 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.954079:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074932.954081:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074932.954085:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fec8c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf0f expref: 428 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074932.954092:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074932.954155:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67822:x1855007616205952:12345-192.168.204.32@tcp:101:rm.0 Request processed in 680us (1755us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074932.954163:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9766 00000100:00100000:3.0:1769074932.973731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.973902:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206080 00000100:00100000:1.0:1769074932.973913:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206080 00000100:00100000:1.0:1769074932.973970:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9767 00000100:00100000:1.0:1769074932.973981:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67823:x1855007616206080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.974004:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.974035:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec8dd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf16 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.974102:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074932.974116:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974128:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974142:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074932.974149:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974156:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974223:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974230:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974236:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974242:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974251:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.974255:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974262:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.974277:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.974281:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974287:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec8e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974301:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974306:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974312:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974318:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074932.974321:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974327:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974333:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff91604ec3c600) 00010000:00010000:1.0:1769074932.974336:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.974339:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974344:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec8eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074932.974373:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec8dd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf16 expref: 428 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.974382:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074932.974384:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074932.974387:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48d200/0x557988ac98fec8dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf16 expref: 428 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074932.974397:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074932.974464:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67823:x1855007616206080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 483us (742us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074932.974471:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9767 00000100:00100000:2.0:1769074932.979948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.980116:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206208 00000100:00100000:0.0:1769074932.980126:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206208 00000100:00100000:0.0:1769074932.980195:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9768 00000100:00100000:0.0:1769074932.980204:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67823:x1855007616206208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074932.980225:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.980247:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf1d expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.980317:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.980335:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980346:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980360:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.980366:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980372:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980424:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980430:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980435:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980445:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980451:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.980455:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980462:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980473:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.980476:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.980480:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980485:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec8f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980927:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980936:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980942:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980947:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.980951:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980957:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980970:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff916052ae5f00) 00010000:00010000:0.0:1769074932.980972:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.980976:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.980982:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec900 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.981016:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8f2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf1d expref: 428 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.981037:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.981040:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.981043:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec8f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf1d expref: 428 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.981054:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fba00, rc 0) 00000100:00100000:0.0:1769074932.981124:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67823:x1855007616206208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 920us (1185us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074932.981131:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9768 00000100:00100000:2.0:1769074932.990896:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074932.990992:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206464 00000100:00100000:0.0:1769074932.991004:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206464 00000100:00100000:0.0:1769074932.991073:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9769 00000100:00100000:0.0:1769074932.991084:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67823:x1855007616206464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074932.991104:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074932.991127:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec907 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf24 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.991417:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.991431:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.991442:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.991457:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.991463:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.991469:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:0.0:1769074932.991984:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd2:0x0], index 0: 0 00010000:00010000:0.0:1769074932.992140:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec91c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074932.992151:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec91c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992158:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec91c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992359:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992367:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992377:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992383:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992389:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074932.992392:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992399:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992411:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074932.992414:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074932.992419:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992425:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fec90e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:0.0:1769074932.992441:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001f1459d2 reply state 00000000700787c4 transno 4294969146 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992453:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074932.992458:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff916052ae5f00) 00010000:00010000:0.0:1769074932.992461:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074932.992463:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074932.992495:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fec907 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf24 expref: 430 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.992513:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa400/0x557988ac98fec91c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf24 expref: 429 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074932.992520:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ae:0x0].0x0 (ffff916052ae5000) 00010000:00010000:0.0:1769074932.992522:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074932.992525:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa400, rc 0) 00000100:00100000:0.0:1769074932.992623:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67823:x1855007616206464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1541us (1737us total) trans 4294969146 rc 0/0 00000100:00100000:0.0:1769074932.993337:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9769 00000100:00100000:3.0:1769074932.997560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074932.997923:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206592 00000100:00100000:1.0:1769074932.997933:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206592 00000100:00100000:1.0:1769074932.997989:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2834 00000100:00100000:1.0:1769074932.997998:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616206592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074932.998016:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074932.998047:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf2b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074932.998070:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074932.998090:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.998092:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074932.998100:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.998117:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074932.998130:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074932.998383:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616206592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 385us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074932.998391:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2834 00000100:00100000:2.0:1769074932.999870:0:8615:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8615:1855007626642560:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1769074932.999928:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074932.999998:0:8615:0:(client.c:2690:ptlrpc_set_wait()) set ffff916141254c00 going to sleep for 11 seconds 00000100:00100000:3.0:1769074933.000083:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626642560 00000100:00100000:3.0:1769074933.000091:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626642560 00000100:00100000:3.0:1769074933.000137:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:3.0:1769074933.000145:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:8615:x1855007626642560:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1769074933.000194:0:25313:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 226 00000100:00100000:2.0:1769074933.003848:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:8615:x1855007626642560:12345-0@lo:5:osp-pre-0-1.0 Request processed in 3694us (3910us total) trans 4294967863 rc 0/0 00000100:00100000:2.0:1769074933.003860:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:0.0:1769074933.004567:0:8615:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8615:1855007626642560:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1769074933.004586:0:8615:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xd2:0x0]-[0x280000400:0x101:0x0] 00000100:00100000:2.0:1769074933.008241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.008516:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206720 00000100:00100000:1.0:1769074933.008526:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206720 00000100:00100000:1.0:1769074933.008606:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2836 00000100:00100000:1.0:1769074933.008615:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:67823:x1855007616206720:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.008644:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.008663:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf32 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.008695:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.008702:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.008704:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.008707:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf32 expref: 221 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.008738:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.008756:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074933.008770:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626642688:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074933.008857:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f600 going to sleep for 11 seconds 00000100:00080000:2.0:1769074933.009884:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074933.012674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.012812:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616206848 00000100:00100000:0.0:1769074933.012821:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616206848 00010000:00010000:0.0:1769074933.012876:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 222 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:0.0:1769074933.012912:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1944 00000100:00100000:0.0:1769074933.012919:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614c09f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2420:x1855007616206848:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074933.012933:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074933.012952:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 222 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074933.012965:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 222 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074933.012993:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074933.012995:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074933.013002:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf32 expref: 222 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.013013:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf32 expref: 222 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.013058:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf32 expref: 222 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074933.013071:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626642816:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074933.013148:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1769074933.013853:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604e095800/0x557988ac98fec92a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf2b expref: 222 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074933.013869:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626642688:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074933.013893:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f48d200/0x557988ac98fec931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf32 expref: 221 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.013904:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48d200, rc 0) 00000100:00100000:1.0:1769074933.013956:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:67823:x1855007616206720:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5341us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.013963:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2836 00000100:00100000:3.0:1769074933.019685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.019808:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207104 00000100:00100000:1.0:1769074933.019820:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207104 00000100:00100000:1.0:1769074933.019883:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1929 00000100:00100000:1.0:1769074933.019894:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+430:67823:x1855007616207104:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074933.020354:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67823:x1855007616207104:12345-192.168.204.32@tcp:35:cp.0 Request processed in 460us (678us total) trans 4294969147 rc 0/0 00000100:00100000:1.0:1769074933.020362:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1929 00000100:00100000:0.0:1769074933.020471:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626642816:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074933.020493:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074933.020518:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614c09f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616206848:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7599us (7853us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074933.020526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1944 00000100:00080000:2.0:1769074933.020664:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1769074933.058232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.058434:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207232 00000100:00100000:2.0:1769074933.058445:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207232 00000100:00100000:2.0:1769074933.058845:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9770 00000100:00100000:2.0:1769074933.058855:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67826:x1855007616207232:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074933.058876:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.058897:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec938 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf39 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.058963:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.058978:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.058990:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059004:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.059011:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059031:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059089:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059095:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059101:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059107:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059113:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.059117:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059123:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059134:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.059138:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.059141:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059147:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fec93f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059159:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059164:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059169:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059186:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.059189:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059194:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059200:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604e58ce00) 00010000:00010000:2.0:1769074933.059202:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.059205:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059210:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fec946 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.059238:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec938 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf39 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.059248:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.059251:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.059254:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fec938 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf39 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.059263:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074933.059330:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67826:x1855007616207232:12345-192.168.204.32@tcp:101:bash.0 Request processed in 476us (1107us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.059337:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9770 00000100:00080000:3.0:1769074933.066520:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769074933.076144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.076353:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207360 00000100:00100000:1.0:1769074933.076364:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207360 00000100:00100000:1.0:1769074933.076425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9771 00000100:00100000:1.0:1769074933.076435:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67827:x1855007616207360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074933.076459:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.076482:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec94d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf63 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.076612:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.076803:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076817:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076856:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.076866:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076873:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076931:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076938:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076945:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076956:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076961:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f16da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.076965:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076971:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076983:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.076986:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.076991:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.076996:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f16da00/0x557988ac98fec954 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077009:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077015:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077031:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077036:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.077039:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077045:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077056:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec3c100) 00010000:00010000:1.0:1769074933.077059:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.077061:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077066:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec95b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.077099:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec94d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf63 expref: 432 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.077109:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.077111:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.077115:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fec94d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf63 expref: 432 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.077123:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074933.077374:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67827:x1855007616207360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 939us (1237us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.077382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9771 00000100:00100000:0.0:1769074933.084952:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.085081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.085152:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207616 00000100:00100000:3.0:1769074933.085163:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207616 00000100:00100000:3.0:1769074933.085232:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 275 00000100:00100000:3.0:1769074933.085242:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:2417:x1855007616207616:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074933.085296:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.085316:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec962 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf40 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.085378:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074933.085394:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085404:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085421:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074933.085428:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085434:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085488:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085884:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085891:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085897:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.085901:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085908:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085921:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.085923:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.085928:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085934:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec969 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085946:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085951:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085955:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085959:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e2a7800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.085961:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085966:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085972:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604ec2fa00) 00010000:00010000:3.0:1769074933.085974:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.085976:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.085984:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec970 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.086013:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec962 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf40 expref: 432 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.086033:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.086035:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074933.086038:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec962 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf40 expref: 432 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.086047:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc -2) 00000100:00100000:3.0:1769074933.086107:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:2417:x1855007616207616:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 867us (1027us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074933.086115:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 275 00000100:00100000:1.0:1769074933.089147:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207488 00000100:00100000:1.0:1769074933.089161:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207488 00000100:00100000:1.0:1769074933.089400:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9772 00000100:00100000:1.0:1769074933.089410:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67827:x1855007616207488:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074933.089430:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.089450:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec977 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf71 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.089558:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.089573:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089584:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089598:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.089604:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089610:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089779:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089787:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089793:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089800:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089805:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.089810:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089820:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089831:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.089834:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.089838:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089843:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec97e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089854:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089860:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089864:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089868:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.089871:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089875:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089882:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec3c100) 00010000:00010000:1.0:1769074933.089884:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.089886:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089890:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec985 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.089917:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec977 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf71 expref: 432 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.089926:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.089929:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.089932:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec977 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf71 expref: 432 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.089940:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc 0) 00000100:00100000:1.0:1769074933.090024:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67827:x1855007616207488:12345-192.168.204.32@tcp:101:rm.0 Request processed in 606us (5073us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.090031:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9772 00000100:00100000:0.0:1769074933.113153:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.113258:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207744 00000100:00100000:1.0:1769074933.113268:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207744 00000100:00100000:1.0:1769074933.113328:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9773 00000100:00100000:1.0:1769074933.113338:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67830:x1855007616207744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.113360:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.113381:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec98c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf86 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.113447:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.113464:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113474:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113492:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.113498:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113503:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113597:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113604:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113611:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113617:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113624:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.113753:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113762:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113773:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.113776:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.113781:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113787:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fec993 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113802:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113809:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113815:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113819:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.113821:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113826:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113832:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec3c100) 00010000:00010000:1.0:1769074933.113835:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.113837:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113842:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fec99a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.113874:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec98c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf86 expref: 432 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.113884:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.113887:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.113890:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fec98c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf86 expref: 432 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.113902:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc 0) 00000100:00100000:1.0:1769074933.114009:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67830:x1855007616207744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 671us (865us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.114025:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9773 00000100:00100000:2.0:1769074933.116512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.120073:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616207872 00000100:00100000:3.0:1769074933.120091:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616207872 00000100:00100000:3.0:1769074933.120162:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 276 00000100:00100000:1.0:1769074933.120385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.120411:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208000 00000100:00100000:1.0:1769074933.120414:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208000 00000100:00100000:1.0:1769074933.120448:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9774 00000100:00100000:1.0:1769074933.120456:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:67830:x1855007616208000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.120478:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.120510:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fec9a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bfc5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.120617:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.120932:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.120947:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.120964:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:1.0:1769074933.120971:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.120977:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121041:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121049:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121054:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121059:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121065:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.121069:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121076:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121087:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.121091:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.121096:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121103:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fec9a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121117:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121123:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121128:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121134:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.121136:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121142:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121150:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec3cd00) 00010000:00010000:1.0:1769074933.121152:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.121155:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121160:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fec9af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:1.0:1769074933.121354:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fec9a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfc5 expref: 433 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.121365:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.121368:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.121371:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fec9a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfc5 expref: 433 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.121381:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2c00, rc 0) 00000100:00100000:1.0:1769074933.121442:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:67830:x1855007616208000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 987us (1059us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.121450:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9774 00000100:00100000:3.0:1769074933.121548:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:2420:x1855007616207872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074933.121597:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.121608:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bf8d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.121735:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074933.121746:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121757:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121771:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074933.121777:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121784:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121811:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121818:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121824:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121829:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.121833:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121838:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121846:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.121849:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.121852:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121857:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fec9bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121867:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121873:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121878:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121883:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.121886:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121892:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121898:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604ec2fa00) 00010000:00010000:3.0:1769074933.121900:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.121903:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121908:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fec9c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074933.121927:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9b6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf8d expref: 432 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.121935:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.121937:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074933.121941:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bf8d expref: 432 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.121952:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc -2) 00000100:00100000:3.0:1769074933.121993:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:2420:x1855007616207872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1822us (5501us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074933.122001:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 276 00000100:00100000:1.0:1769074933.139843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.140027:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208256 00000100:00100000:3.0:1769074933.140037:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208256 00000100:00100000:3.0:1769074933.140101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9775 00000100:00100000:3.0:1769074933.140111:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:67830:x1855007616208256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.140130:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.140152:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec9cb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bfcc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.140286:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.140302:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.140312:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.140327:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x15b40051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.140334:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.140340:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074933.141321:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd3:0x0], index 1: 0 00010000:00010000:3.0:1769074933.141485:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fec9e0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.141522:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fec9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141835:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fec9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141877:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141885:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141891:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141897:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141904:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.141908:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141914:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141925:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.141928:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.141932:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141942:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fec9d2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074933.141957:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc26afbd reply state 00000000786510ef transno 4294969148 ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141967:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.141974:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec2f400) 00010000:00010000:3.0:1769074933.141976:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074933.141979:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074933.142014:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fec9cb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfcc expref: 434 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.142037:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91615db8ca00/0x557988ac98fec9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfcc expref: 433 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.142044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1af:0x0].0x0 (ffff91604ec2f200) 00010000:00010000:3.0:1769074933.142047:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074933.142049:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91615db8ca00, rc 0) 00000100:00100000:3.0:1769074933.142167:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+434:67830:x1855007616208256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2057us (2333us total) trans 4294969148 rc 0/0 00000100:00100000:3.0:1769074933.142176:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9775 00000100:00100000:3.0:1769074933.147643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.147731:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208384 00000100:00100000:1.0:1769074933.147745:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208384 00000100:00100000:1.0:1769074933.147816:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2837 00000100:00100000:1.0:1769074933.147826:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2418:x1855007616208384:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.147844:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.147865:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bfd3 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074933.147893:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074933.147913:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.147915:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.147924:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 219 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.147940:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 219 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.147953:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3600, rc 0) 00000100:00100000:1.0:1769074933.148010:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2418:x1855007616208384:12345-192.168.204.32@tcp:101:cp.0 Request processed in 184us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.148027:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2837 00000100:00080000:2.0:1769074933.148849:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074933.152515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.152835:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208512 00000100:00100000:3.0:1769074933.152846:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208512 00000100:00100000:3.0:1769074933.152897:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2838 00000100:00100000:3.0:1769074933.152906:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:67830:x1855007616208512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.152927:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.152947:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bfda expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.152978:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.152986:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.152988:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.152991:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfda expref: 220 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.153035:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.153049:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:3.0:1769074933.153062:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149864700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626642944:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074933.153373:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ed0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074933.155868:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149864700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626642944:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074933.155906:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfda expref: 220 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.155925:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e2a7800, rc 0) 00000100:00100000:3.0:1769074933.155982:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:67830:x1855007616208512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3077us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074933.155992:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2838 00000100:00100000:2.0:1769074933.158936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.159037:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208640 00000100:00100000:0.0:1769074933.159048:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208640 00010000:00010000:0.0:1769074933.159100:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:0.0:1769074933.159186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1945 00000100:00100000:0.0:1769074933.159196:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616208640:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074933.159210:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074933.159229:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074933.159243:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074933.159265:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3600/0x557988ac98fec9ee lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfd3 expref: 220 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:0.0:1769074933.159279:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074933.159281:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074933.159288:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfda expref: 219 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.159297:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfda expref: 219 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.159331:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e2a7800/0x557988ac98fec9f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfda expref: 219 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074933.159344:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617735c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626643072:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074933.159468:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6600 going to sleep for 11 seconds 00000100:00100000:1.0:1769074933.164832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.164904:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616208896 00000100:00100000:3.0:1769074933.164914:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616208896 00000100:00100000:3.0:1769074933.164972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1930 00000100:00100000:3.0:1769074933.164982:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+434:67830:x1855007616208896:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074933.165295:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67830:x1855007616208896:12345-192.168.204.32@tcp:35:cp.0 Request processed in 314us (473us total) trans 4294969149 rc 0/0 00000100:00100000:3.0:1769074933.165303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1930 00000100:00100000:0.0:1769074933.168699:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617735c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626643072:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074933.168728:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074933.168789:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616208640:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9594us (9862us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074933.168799:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1945 00000100:00100000:1.0:1769074933.202607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.207363:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209024 00000100:00100000:2.0:1769074933.207382:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209024 00000100:00100000:2.0:1769074933.207598:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 277 00000100:00100000:2.0:1769074933.207609:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2420:x1855007616209024:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074933.209687:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.209714:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec9fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2bfe1 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.209777:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.209793:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209806:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209821:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.209828:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209835:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209888:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209898:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209904:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209909:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.209913:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209921:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209932:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.209935:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.209940:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209946:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209961:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209968:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209973:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209979:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.209981:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209990:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.209996:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58ce00) 00010000:00010000:2.0:1769074933.209998:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.210001:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.210006:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.210047:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec9fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfe1 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.210058:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.210060:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074933.210063:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fec9fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2bfe1 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.210073:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423000, rc -2) 00000100:00100000:2.0:1769074933.210147:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2420:x1855007616209024:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2539us (7549us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074933.210157:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 277 00000100:00100000:1.0:1769074933.225862:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.226026:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209152 00000100:00100000:3.0:1769074933.226037:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209152 00000100:00100000:3.0:1769074933.226102:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9776 00000100:00100000:3.0:1769074933.226112:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67838:x1855007616209152:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074933.226133:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.226158:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c019 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.226394:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.226409:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.226420:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.226435:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.226442:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.226450:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227065:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227075:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227081:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227086:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227092:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.227097:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227104:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227117:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.227120:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.227125:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227131:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98feca18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227144:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227150:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227156:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227160:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.227163:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227168:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227338:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff91604ec2fa00) 00010000:00010000:3.0:1769074933.227341:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.227344:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227350:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca1f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.227391:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca11 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c019 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.227403:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.227405:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.227408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c019 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.227416:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:3.0:1769074933.227647:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67838:x1855007616209152:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1534us (1792us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074933.227655:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9776 00000100:00100000:1.0:1769074933.244149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.244419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.244673:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209408 00000100:00100000:2.0:1769074933.244684:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209408 00000100:00100000:2.0:1769074933.244750:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 278 00000100:00100000:2.0:1769074933.244762:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2420:x1855007616209408:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074933.244822:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.244844:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c027 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.244902:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.244916:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.244927:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.244940:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.244946:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.244953:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245005:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245012:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245032:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245037:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.245041:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245048:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245060:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.245063:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.245067:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245072:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245087:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245091:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245096:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245100:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.245103:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245108:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245113:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58ce00) 00010000:00010000:2.0:1769074933.245116:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.245119:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245124:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca34 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.245152:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca26 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c027 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.245161:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.245164:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074933.245167:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c027 expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.245470:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc -2) 00000100:00100000:2.0:1769074933.245691:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2420:x1855007616209408:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 929us (1270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074933.245700:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 278 00000100:00100000:3.0:1769074933.245900:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209280 00000100:00100000:3.0:1769074933.245908:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209280 00000100:00100000:3.0:1769074933.245959:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9777 00000100:00100000:3.0:1769074933.245966:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67839:x1855007616209280:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074933.245979:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.245993:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca3b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c020 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.246051:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.246062:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246070:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246085:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074933.246091:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246098:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246135:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246142:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246147:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246157:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246163:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.246166:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246342:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246353:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.246356:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.246360:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246365:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca42 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246375:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246380:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246386:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246391:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.246393:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246398:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246408:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff91604ec2fa00) 00010000:00010000:3.0:1769074933.246410:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.246413:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246417:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca49 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074933.246443:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca3b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c020 expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.246451:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.246453:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.246457:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca3b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c020 expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.246465:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:3.0:1769074933.246832:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67839:x1855007616209280:12345-192.168.204.32@tcp:101:rm.0 Request processed in 865us (2690us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074933.246839:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9777 00000100:00100000:1.0:1769074933.258466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.258691:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209536 00000100:00100000:0.0:1769074933.258704:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209536 00000100:00100000:0.0:1769074933.258761:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9778 00000100:00100000:0.0:1769074933.258770:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67839:x1855007616209536:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074933.258790:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.258812:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c05f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.258891:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.258906:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.258917:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.258932:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.258939:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.258945:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259000:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259007:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259012:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259027:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259033:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.259038:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259045:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259056:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.259059:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.259064:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259069:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259085:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259093:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259098:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259104:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.259107:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259113:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259119:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff916052ae5300) 00010000:00010000:0.0:1769074933.259121:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.259123:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca5e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.259157:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca50 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c05f expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.259167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.259483:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.259500:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c05f expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.259511:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb200, rc 0) 00000100:00100000:0.0:1769074933.259713:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67839:x1855007616209536:12345-192.168.204.32@tcp:101:rm.0 Request processed in 942us (1257us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.259723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9778 00000100:00100000:1.0:1769074933.284862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.285086:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209664 00000100:00100000:0.0:1769074933.285098:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209664 00000100:00100000:0.0:1769074933.285164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9779 00000100:00100000:0.0:1769074933.285186:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67842:x1855007616209664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074933.285205:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.285227:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca65 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c066 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.285293:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.285307:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285317:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285331:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.285338:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285344:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285398:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285406:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285411:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285418:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285424:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.285428:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285436:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285448:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.285452:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.285456:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285462:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98feca6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285476:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285482:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285488:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285862:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.285865:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285872:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff916052ae5300) 00010000:00010000:0.0:1769074933.285989:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.285993:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.285999:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98feca73 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.286046:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca65 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c066 expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.286056:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.286058:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.286061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98feca65 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c066 expref: 436 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.286069:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb200, rc 0) 00000100:00100000:0.0:1769074933.286130:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67842:x1855007616209664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 959us (1282us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.286139:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9779 00000100:00100000:0.0:1769074933.290721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.290749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.290838:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209792 00000100:00100000:2.0:1769074933.290849:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209792 00000100:00100000:2.0:1769074933.290909:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 279 00000100:00100000:2.0:1769074933.290918:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2418:x1855007616209792:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074933.290975:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.290995:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca7a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c06d expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.291063:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.291077:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291088:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291103:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.291114:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291120:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291179:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291186:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291192:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291197:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.291201:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291207:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291219:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.291223:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.291227:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291232:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98feca81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291247:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291252:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291258:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291262:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.291264:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291270:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291277:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58ce00) 00010000:00010000:2.0:1769074933.291279:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.291281:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291287:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feca88 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.291315:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca7a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c06d expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.291324:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.291326:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074933.291330:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98feca7a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c06d expref: 436 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.291338:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc -2) 00000100:00100000:2.0:1769074933.291401:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:2418:x1855007616209792:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 484us (689us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074933.291409:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 279 00000100:00100000:3.0:1769074933.292102:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616209920 00000100:00100000:3.0:1769074933.292110:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616209920 00000100:00100000:3.0:1769074933.292159:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9780 00000100:00100000:3.0:1769074933.292181:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67842:x1855007616209920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.292194:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.292208:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0a5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.292256:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074933.292266:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292275:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292286:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074933.292293:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292299:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292334:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292341:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292347:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292353:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292359:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.292362:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292372:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292381:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.292383:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.292387:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292392:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98feca96 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292403:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292409:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292415:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292419:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.292421:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292426:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292432:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff91604ec2fa00) 00010000:00010000:3.0:1769074933.292434:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.292436:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292442:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98feca9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.292463:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca8f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0a5 expref: 436 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.292470:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.292472:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.292475:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feca8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0a5 expref: 436 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.292482:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:3.0:1769074933.292519:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67842:x1855007616209920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 354us (1769us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074933.292526:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9780 00000100:00100000:0.0:1769074933.298812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.298900:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210176 00000100:00100000:2.0:1769074933.298912:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210176 00000100:00100000:2.0:1769074933.298973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9781 00000100:00100000:2.0:1769074933.298983:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:67842:x1855007616210176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.299006:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.299057:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fecaa4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.299387:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.299403:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.299415:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.299430:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.299437:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.299443:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074933.299823:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd3:0x0], index 0: 0 00010000:00010000:2.0:1769074933.299979:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fecab9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.299989:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fecab9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.299997:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fecab9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300039:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300046:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300051:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300057:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300062:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.300066:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300073:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300085:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.300088:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.300092:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300097:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaab lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074933.300108:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bfb4b8ac reply state 0000000092860d64 transno 4294969150 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300118:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.300123:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff91604e58cf00) 00010000:00010000:2.0:1769074933.300125:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074933.300128:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074933.300158:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423c00/0x557988ac98fecaa4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ac expref: 438 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.300171:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422200/0x557988ac98fecab9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ac expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.300191:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b0:0x0].0x0 (ffff91604e58ce00) 00010000:00010000:2.0:1769074933.300193:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074933.300196:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422200, rc 0) 00000100:00100000:2.0:1769074933.300261:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+438:67842:x1855007616210176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1279us (1459us total) trans 4294969150 rc 0/0 00000100:00100000:2.0:1769074933.300270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9781 00000100:00100000:1.0:1769074933.304786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.305225:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210304 00000100:00100000:3.0:1769074933.305236:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210304 00000100:00100000:3.0:1769074933.305294:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2839 00000100:00100000:3.0:1769074933.305304:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2418:x1855007616210304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.305321:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.305344:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0b3 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074933.305366:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074933.305386:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.305388:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.305397:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 221 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.305412:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 221 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.305426:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:3.0:1769074933.305501:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616210304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 190us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074933.305507:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2839 00000100:00100000:1.0:1769074933.310029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.310153:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210432 00000100:00100000:2.0:1769074933.310164:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210432 00000100:00100000:2.0:1769074933.310347:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2840 00000100:00100000:2.0:1769074933.310357:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:67842:x1855007616210432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.310374:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.310391:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0ba expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.310422:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 222 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.310430:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.310432:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.310435:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ba expref: 222 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.310476:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 222 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.310488:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 222 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:2.0:1769074933.310501:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626643200:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074933.310665:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916147f836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074933.313994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.314093:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210560 00000100:00100000:1.0:1769074933.314103:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210560 00010000:00010000:1.0:1769074933.314156:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 223 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074933.314240:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1946 00000100:00100000:1.0:1769074933.314250:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616210560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074933.314265:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074933.314285:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 223 pid: 8406 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.314298:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 223 pid: 8406 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.314324:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.314326:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.314333:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ba expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.314343:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ba expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.314377:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ba expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074933.314391:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626643328:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074933.314483:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f600 going to sleep for 11 seconds 00010000:00010000:2.0:1769074933.316960:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff916052adbe00/0x557988ac98fecac7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0b3 expref: 223 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:2.0:1769074933.316985:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626643200:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074933.317026:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f423c00/0x557988ac98fecace lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0ba expref: 222 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.317041:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423c00, rc 0) 00000100:00100000:2.0:1769074933.317116:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:67842:x1855007616210432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6759us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074933.317126:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2840 00000100:00100000:1.0:1769074933.322442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.322518:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210816 00000100:00100000:2.0:1769074933.322528:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210816 00000100:00100000:2.0:1769074933.322599:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1931 00000100:00100000:2.0:1769074933.322609:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+438:67842:x1855007616210816:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074933.322897:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67842:x1855007616210816:12345-192.168.204.32@tcp:35:cp.0 Request processed in 288us (466us total) trans 4294969151 rc 0/0 00000100:00100000:2.0:1769074933.322906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1931 00000100:00100000:0.0:1769074933.331170:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626643328:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074933.331211:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074933.331277:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2419:x1855007616210560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 17027us (17290us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074933.331289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1946 00000100:00100000:1.0:1769074933.370707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.370809:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616210944 00000100:00100000:0.0:1769074933.370820:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616210944 00000100:00100000:0.0:1769074933.370886:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 280 00000100:00100000:0.0:1769074933.370896:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:2419:x1855007616210944:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074933.370954:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.370975:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecad5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0c1 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.371049:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074933.371064:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371075:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371090:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074933.371097:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371104:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371152:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371160:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371166:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371172:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.371190:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371197:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371209:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.371213:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.371217:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371224:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecadc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371237:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371243:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371248:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371253:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.371256:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371261:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371268:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff916052ae5300) 00010000:00010000:0.0:1769074933.371271:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.371274:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371283:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecae3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.371311:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecad5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0c1 expref: 440 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.371331:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.371334:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074933.371339:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecad5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0c1 expref: 440 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.371348:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfac00, rc -2) 00000100:00100000:0.0:1769074933.371411:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:2419:x1855007616210944:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 517us (714us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074933.371419:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 280 00000100:00100000:1.0:1769074933.383684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.383851:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211072 00000100:00100000:3.0:1769074933.383862:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211072 00000100:00100000:3.0:1769074933.383931:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9782 00000100:00100000:3.0:1769074933.383940:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67849:x1855007616211072:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074933.383960:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.383982:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fecaea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c0f9 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.384063:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074933.384078:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384089:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384105:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:3.0:1769074933.384112:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384119:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384434:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384442:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384448:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384454:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384460:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052adbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.384465:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384471:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384484:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.384486:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.384606:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384614:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbe00/0x557988ac98fecaf1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384828:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384836:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384841:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384847:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916052b15c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.384850:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384856:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384865:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff91604ec2fd00) 00010000:00010000:3.0:1769074933.384868:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.384871:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384876:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98fecaf8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074933.384994:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fecaea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0f9 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.385005:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.385007:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.385021:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916052adbc00/0x557988ac98fecaea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c0f9 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.385031:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:2.0:1769074933.385210:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67849:x1855007616211072:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1269us (1532us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.385220:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9782 00000100:00100000:1.0:1769074933.410975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.411185:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211200 00000100:00100000:2.0:1769074933.411197:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211200 00000100:00100000:2.0:1769074933.411263:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9783 00000100:00100000:2.0:1769074933.411274:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67850:x1855007616211200:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.411294:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.411315:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c100 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.411780:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.411796:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.411806:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.411820:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.411828:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.411834:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.411889:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412287:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412294:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412301:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412307:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.412312:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412319:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412414:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.412418:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.412423:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412429:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecb06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412445:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412450:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412456:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412460:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.412463:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412468:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412474:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff91604e58c000) 00010000:00010000:2.0:1769074933.412477:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.412479:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412485:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb0d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.412615:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaff lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c100 expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.412780:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.412782:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.412788:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecaff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c100 expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.412798:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423600, rc 0) 00000100:00100000:2.0:1769074933.413149:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67850:x1855007616211200:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1875us (2181us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.413159:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9783 00000100:00100000:1.0:1769074933.420526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.421144:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211328 00000100:00100000:2.0:1769074933.421154:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211328 00000100:00100000:2.0:1769074933.421212:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 281 00000100:00100000:2.0:1769074933.421221:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:2419:x1855007616211328:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074933.421259:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.421279:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecb14 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c107 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.421343:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.421358:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421370:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421384:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074933.421392:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421398:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421446:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421453:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421459:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421464:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.421468:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421478:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421489:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.421508:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.421513:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421519:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421555:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421561:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421567:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421572:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.421575:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421581:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421588:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e58c300) 00010000:00010000:2.0:1769074933.421590:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.421593:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421598:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb22 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074933.421638:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecb14 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c107 expref: 440 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.421649:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.421651:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074933.421655:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecb14 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c107 expref: 440 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.421664:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc -2) 00000100:00100000:2.0:1769074933.421729:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:2419:x1855007616211328:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 507us (1211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074933.421737:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 281 00000100:00100000:3.0:1769074933.429868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.430027:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211456 00000100:00100000:0.0:1769074933.430038:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211456 00000100:00100000:0.0:1769074933.430099:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9784 00000100:00100000:0.0:1769074933.430110:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67850:x1855007616211456:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074933.430130:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.430151:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c10e expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.430234:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.430249:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.430264:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.430278:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.430285:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.430290:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.430891:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431001:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431008:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431022:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431027:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.431031:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431038:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431052:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.431055:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.431061:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431067:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb30 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431083:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431088:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431093:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431098:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.431101:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431106:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431112:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff916052ae5300) 00010000:00010000:0.0:1769074933.431114:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.431117:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431123:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb37 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.431158:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb29 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c10e expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.431168:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.431308:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.431313:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c10e expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.431404:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074933.431480:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67850:x1855007616211456:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1370us (1619us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.431489:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9784 00000100:00100000:2.0:1769074933.450437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.450568:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211584 00000100:00100000:0.0:1769074933.450580:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211584 00000100:00100000:0.0:1769074933.450642:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9785 00000100:00100000:0.0:1769074933.450653:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67851:x1855007616211584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074933.450674:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.450698:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c115 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.450761:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.450777:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450787:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450801:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.450808:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450815:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450864:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450872:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450878:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450883:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450889:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.450892:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450911:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450922:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.450926:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.450930:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450935:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fecb45 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450949:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450955:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450960:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450965:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.450967:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450972:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450979:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff916052ae5300) 00010000:00010000:0.0:1769074933.450981:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.450984:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.450990:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fecb4c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.451028:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb3e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c115 expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.451039:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.451041:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.451045:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fecb3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c115 expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.451055:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074933.451178:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67851:x1855007616211584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 519us (743us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.451186:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9785 00000100:00100000:1.0:1769074933.454684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.454842:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211712 00000100:00100000:0.0:1769074933.454853:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211712 00000100:00100000:0.0:1769074933.454905:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9786 00000100:00100000:0.0:1769074933.454915:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67851:x1855007616211712:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074933.454935:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.454956:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fecb53 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c11c expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.455029:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.455045:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455055:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455069:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.455076:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455082:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455129:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455137:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455143:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455150:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455157:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.455161:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455169:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455192:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.455195:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.455199:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455205:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fecb5a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455218:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455224:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455229:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455234:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.455237:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455244:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455251:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff916052ae5500) 00010000:00010000:0.0:1769074933.455253:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.455256:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455261:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fecb61 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.455289:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fecb53 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c11c expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.455298:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.455300:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.455304:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fecb53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c11c expref: 440 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.455315:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fba00, rc 0) 00000100:00100000:0.0:1769074933.455577:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67851:x1855007616211712:12345-192.168.204.32@tcp:101:cp.0 Request processed in 662us (902us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.455585:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9786 00000100:00100000:0.0:1769074933.465848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.466030:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616211968 00000100:00100000:2.0:1769074933.466041:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616211968 00000100:00100000:2.0:1769074933.466097:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9787 00000100:00100000:2.0:1769074933.466106:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:67851:x1855007616211968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.466126:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.466147:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb68 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c123 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.466274:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.466290:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466301:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466315:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.466321:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466327:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074933.466654:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd4:0x0], index 1: 0 00010000:00010000:2.0:1769074933.466806:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb7d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.466816:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb7d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466824:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb7d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466859:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466866:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466873:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466879:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466886:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.466889:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466897:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466908:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.466911:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.466916:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466922:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecb6f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074933.466936:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000339aae49 reply state 000000006883da94 transno 4294969152 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466947:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.466953:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff91604e58c300) 00010000:00010000:2.0:1769074933.466955:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074933.466958:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074933.466988:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecb68 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c123 expref: 442 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.467002:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423800/0x557988ac98fecb7d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c123 expref: 441 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.467008:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b1:0x0].0x0 (ffff91604e58c000) 00010000:00010000:2.0:1769074933.467021:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074933.467024:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423800, rc 0) 00000100:00100000:2.0:1769074933.467090:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+442:67851:x1855007616211968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 984us (1252us total) trans 4294969152 rc 0/0 00000100:00100000:2.0:1769074933.467102:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9787 00000100:00100000:2.0:1769074933.472033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.472115:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212096 00000100:00100000:3.0:1769074933.472126:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212096 00000100:00100000:3.0:1769074933.472192:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2841 00000100:00100000:3.0:1769074933.472202:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616212096:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.472224:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.472244:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c12a expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074933.472270:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074933.472291:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.472293:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.472302:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.472319:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 220 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.472332:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:3.0:1769074933.472398:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616212096:12345-192.168.204.32@tcp:101:cp.0 Request processed in 197us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074933.472406:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2841 00000100:00100000:0.0:1769074933.482991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.483089:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212224 00000100:00100000:3.0:1769074933.483101:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212224 00000100:00100000:3.0:1769074933.483160:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2842 00000100:00100000:3.0:1769074933.483170:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:67851:x1855007616212224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.483197:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.483216:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c131 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.483246:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.483259:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.483262:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.483266:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c131 expref: 221 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.483301:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.483315:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:3.0:1769074933.483329:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149866680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626643456:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074933.483434:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ed0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074933.486955:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149866680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626643456:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074933.486993:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c131 expref: 221 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.487023:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbc00, rc 0) 00000100:00100000:3.0:1769074933.487088:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:67851:x1855007616212224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3918us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074933.487097:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2842 00000100:00100000:0.0:1769074933.488809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.489073:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212352 00000100:00100000:1.0:1769074933.489084:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212352 00010000:00010000:1.0:1769074933.489142:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074933.489189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1947 00000100:00100000:1.0:1769074933.489198:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2419:x1855007616212352:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074933.489212:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074933.489231:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.489244:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.489267:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff916052b15c00/0x557988ac98fecb8b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c12a expref: 221 pid: 25313 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.489282:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.489284:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.489291:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c131 expref: 220 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.489301:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c131 expref: 220 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.489335:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052adbc00/0x557988ac98fecb92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c131 expref: 220 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074933.489348:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626643584:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074933.489434:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074933.494196:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626643584:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074933.494223:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074933.494276:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616212352:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5078us (5474us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.494285:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1947 00000100:00100000:2.0:1769074933.498605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.498695:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212608 00000100:00100000:3.0:1769074933.498706:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212608 00000100:00100000:3.0:1769074933.498768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1932 00000100:00100000:3.0:1769074933.498778:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+442:67851:x1855007616212608:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074933.499081:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67851:x1855007616212608:12345-192.168.204.32@tcp:35:cp.0 Request processed in 304us (485us total) trans 4294969153 rc 0/0 00000100:00100000:3.0:1769074933.499090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1932 00000100:00100000:0.0:1769074933.555656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.555748:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212736 00000100:00100000:1.0:1769074933.555759:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212736 00000100:00100000:1.0:1769074933.555821:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9788 00000100:00100000:1.0:1769074933.555831:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67854:x1855007616212736:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074933.555852:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.555872:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecb99 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c138 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.555947:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.555962:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.555972:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.555985:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.555990:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.555995:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556061:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556067:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556073:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556079:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556085:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.556088:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556095:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556105:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.556109:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.556113:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556120:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecba0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556132:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556138:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556143:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556149:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.556152:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556157:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556164:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604ec3cd00) 00010000:00010000:1.0:1769074933.556166:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.556326:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556335:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecba7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.556368:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecb99 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c138 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.556378:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.556381:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.556385:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecb99 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c138 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.556394:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074933.556457:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67854:x1855007616212736:12345-192.168.204.32@tcp:101:bash.0 Request processed in 627us (812us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.556465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9788 00000100:00100000:0.0:1769074933.572081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.572198:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212864 00000100:00100000:2.0:1769074933.572210:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212864 00000100:00100000:2.0:1769074933.572321:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9789 00000100:00100000:2.0:1769074933.572332:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67855:x1855007616212864:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.572357:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.572378:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecbae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c13f expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.572445:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.572460:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572472:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572504:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.572512:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572518:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572597:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572610:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572616:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572800:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572806:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.572810:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572818:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572831:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.572834:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.572839:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572845:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecbb5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572862:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572868:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572874:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572880:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.572883:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572891:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572908:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604e58c500) 00010000:00010000:2.0:1769074933.572910:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.572913:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572918:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecbbc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.572952:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecbae lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c13f expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.572961:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.572963:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.572966:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecbae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c13f expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.572974:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423000, rc 0) 00000100:00100000:2.0:1769074933.573053:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67855:x1855007616212864:12345-192.168.204.32@tcp:101:rm.0 Request processed in 724us (982us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.573061:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9789 00000100:00100000:0.0:1769074933.576552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.576588:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616212992 00000100:00100000:0.0:1769074933.576599:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616212992 00000100:00100000:0.0:1769074933.576666:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 282 00000100:00100000:0.0:1769074933.576676:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:2418:x1855007616212992:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074933.576708:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.576729:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecbc3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c146 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.576784:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074933.576800:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.576810:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.576823:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074933.576830:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.576836:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.576886:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577297:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577306:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577312:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.577315:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577322:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577334:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.577338:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.577342:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577347:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecbca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577359:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577364:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577369:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577373:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.577375:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577380:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577387:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff916052ae5500) 00010000:00010000:0.0:1769074933.577389:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.577391:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577396:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecbd1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074933.577424:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecbc3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c146 expref: 444 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.577434:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.577436:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074933.577439:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecbc3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c146 expref: 444 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.577447:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee600, rc -2) 00000100:00100000:0.0:1769074933.577661:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:2418:x1855007616212992:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 985us (1140us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074933.577670:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 282 00000100:00100000:0.0:1769074933.581642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.581868:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213120 00000100:00100000:2.0:1769074933.581878:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213120 00000100:00100000:2.0:1769074933.581938:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9790 00000100:00100000:2.0:1769074933.581948:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67855:x1855007616213120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.581972:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.581994:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecbd8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c14d expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.582069:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.582083:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582094:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582109:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.582116:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582122:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582177:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582185:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582191:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582198:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582204:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.582208:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582216:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582227:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.582231:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.582235:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582241:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecbdf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582256:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582262:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582269:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582275:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.582277:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582282:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582290:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604e58c900) 00010000:00010000:2.0:1769074933.582293:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.582296:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582306:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecbe6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.582334:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecbd8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c14d expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.582343:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.582346:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.582349:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecbd8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c14d expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.582357:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074933.582420:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67855:x1855007616213120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 473us (797us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.582429:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9790 00000100:00100000:0.0:1769074933.604848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.605525:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213248 00000100:00100000:1.0:1769074933.605573:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213248 00000100:00100000:1.0:1769074933.605650:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9791 00000100:00100000:1.0:1769074933.605659:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67856:x1855007616213248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.605680:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.605699:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecbed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c154 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.605764:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.605779:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605789:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605804:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.605811:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605817:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605872:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605879:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605884:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605891:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605909:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.605914:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605921:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605933:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.605937:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.605941:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605948:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecbf4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605961:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605967:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605973:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605978:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.605981:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605987:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.605994:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604ec3cd00) 00010000:00010000:1.0:1769074933.605996:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.605999:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.606004:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecbfb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.606064:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecbed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c154 expref: 444 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.606073:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.606076:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.606079:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecbed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c154 expref: 444 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.606087:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074933.606141:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67856:x1855007616213248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 483us (1302us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074933.606149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9791 00000100:00100000:3.0:1769074933.610355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.610697:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213376 00000100:00100000:2.0:1769074933.610708:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213376 00000100:00100000:2.0:1769074933.610766:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9792 00000100:00100000:2.0:1769074933.610775:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67856:x1855007616213376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.610798:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.610819:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecc02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c15b expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.610886:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.610914:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.610931:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.610947:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.610954:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.610961:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611027:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611035:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611041:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611047:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611053:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.611057:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611066:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611078:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.611081:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.611087:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611093:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611107:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611112:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611117:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611121:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.611124:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611129:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611136:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604e58c900) 00010000:00010000:2.0:1769074933.611138:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.611141:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611147:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc10 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.611185:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecc02 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c15b expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.611194:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.611197:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.611201:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422e00/0x557988ac98fecc02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c15b expref: 444 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.611210:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074933.611278:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67856:x1855007616213376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 503us (932us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.611289:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9792 00000100:00100000:0.0:1769074933.616780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.616955:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213632 00000100:00100000:1.0:1769074933.616965:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213632 00000100:00100000:1.0:1769074933.617068:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9793 00000100:00100000:1.0:1769074933.617079:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:67856:x1855007616213632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.617099:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.617119:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecc17 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c162 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.617234:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.617250:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.617260:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.617273:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x35736bae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074933.617278:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074933.617283:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074933.617814:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd4:0x0], index 0: 0 00010000:00010000:0.0:1769074933.618095:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecc2c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.618107:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecc2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618115:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecc2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618150:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618156:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618161:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618462:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618470:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.618475:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618482:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618685:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.618689:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.618695:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecc1e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074933.618717:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007d480a16 reply state 000000008c08967a transno 4294969154 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618727:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.618732:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604ec3cd00) 00010000:00010000:0.0:1769074933.618734:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074933.618737:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074933.618775:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecc17 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c162 expref: 446 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.618791:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efe00/0x557988ac98fecc2c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c162 expref: 445 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.618802:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b2:0x0].0x0 (ffff916052ae5500) 00010000:00010000:0.0:1769074933.618805:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074933.618807:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efe00, rc 0) 00000100:00100000:0.0:1769074933.619059:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+446:67856:x1855007616213632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1981us (2288us total) trans 4294969154 rc 0/0 00000100:00100000:0.0:1769074933.619068:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9793 00000100:00100000:3.0:1769074933.623196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.623689:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213760 00000100:00100000:1.0:1769074933.623700:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213760 00000100:00100000:1.0:1769074933.623761:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2843 00000100:00100000:1.0:1769074933.623770:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2417:x1855007616213760:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.623789:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.623810:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c169 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074933.623838:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074933.623876:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.623878:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.623886:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 222 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.623903:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 222 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.623915:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3600, rc 0) 00000100:00100000:1.0:1769074933.623982:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2417:x1855007616213760:12345-192.168.204.32@tcp:101:cp.0 Request processed in 213us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.623989:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2843 00000100:00100000:3.0:1769074933.629274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.629439:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616213888 00000100:00100000:2.0:1769074933.629448:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616213888 00000100:00100000:2.0:1769074933.629511:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2844 00000100:00100000:2.0:1769074933.629522:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:67856:x1855007616213888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.629569:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.629588:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c170 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.629627:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.629636:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.629637:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.629642:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c170 expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.629679:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.629692:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 223 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:2.0:1769074933.629705:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626643712:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074933.629795:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916147f83840 going to sleep for 11 seconds 00000100:00100000:0.0:1769074933.633228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.633379:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214016 00000100:00100000:1.0:1769074933.633388:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214016 00010000:00010000:1.0:1769074933.633440:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 224 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:1.0:1769074933.633480:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1948 00000100:00100000:1.0:1769074933.633489:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616214016:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074933.633504:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074933.633567:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 224 pid: 8406 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.633585:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 224 pid: 8406 timeout: 2022 lvb_type: 1 00010000:00010000:1.0:1769074933.633610:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.633612:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.633633:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c170 expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.633643:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c170 expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.633680:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c170 expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074933.633694:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626643840:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074933.633790:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1769074933.634454:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecc3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c169 expref: 224 pid: 8406 timeout: 2022 lvb_type: 1 00000100:00100000:2.0:1769074933.634470:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626643712:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074933.634493:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f422e00/0x557988ac98fecc41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c170 expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.634504:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422e00, rc 0) 00000100:00100000:2.0:1769074933.634588:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:67856:x1855007616213888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5067us (5323us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074933.634598:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2844 00000100:00100000:1.0:1769074933.640725:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626643840:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074933.640756:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074933.640820:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2419:x1855007616214016:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7331us (7600us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.640831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1948 00000100:00100000:1.0:1769074933.644240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.644335:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214272 00000100:00100000:2.0:1769074933.644345:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214272 00000100:00100000:2.0:1769074933.644429:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1933 00000100:00100000:2.0:1769074933.644439:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+446:67856:x1855007616214272:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074933.645082:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67856:x1855007616214272:12345-192.168.204.32@tcp:35:cp.0 Request processed in 642us (915us total) trans 4294969155 rc 0/0 00000100:00100000:2.0:1769074933.645091:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1933 00000100:00100000:0.0:1769074933.685954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.686062:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214400 00000100:00100000:2.0:1769074933.686074:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214400 00000100:00100000:2.0:1769074933.686144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9794 00000100:00100000:2.0:1769074933.686155:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67859:x1855007616214400:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074933.686189:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.686213:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c177 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.686279:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.686295:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686310:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686324:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.686331:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686338:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686393:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686400:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686407:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686413:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686420:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.686424:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686431:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.686448:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.686454:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686462:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686477:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686482:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686487:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686501:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.686504:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686509:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686515:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:2.0:1769074933.686518:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.686520:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686581:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc56 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.686615:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc48 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c177 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.686636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.686638:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.686642:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c177 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.686651:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074933.686706:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67859:x1855007616214400:12345-192.168.204.32@tcp:101:bash.0 Request processed in 553us (762us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.686713:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9794 00000100:00100000:0.0:1769074933.700932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.700978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.701079:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214528 00000100:00100000:2.0:1769074933.701091:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214528 00000100:00100000:2.0:1769074933.701151:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9795 00000100:00100000:2.0:1769074933.701162:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67860:x1855007616214528:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.701195:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.701218:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc5d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c17e expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.701285:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.701301:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701317:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701331:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.701338:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701344:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701397:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701405:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701412:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701418:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701424:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.701428:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701435:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701447:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.701451:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.701455:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701461:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701476:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701482:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701487:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701491:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.701494:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701499:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701506:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:2.0:1769074933.701508:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.701510:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701516:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc6b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.701595:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc5d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c17e expref: 448 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.701605:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.701608:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.701612:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c17e expref: 448 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.701631:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074933.701682:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67860:x1855007616214528:12345-192.168.204.32@tcp:101:rm.0 Request processed in 521us (759us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.701690:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9795 00000100:00100000:1.0:1769074933.702164:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214656 00000100:00100000:1.0:1769074933.702180:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214656 00000100:00100000:1.0:1769074933.702222:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 283 00000100:00100000:1.0:1769074933.702229:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:2418:x1855007616214656:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074933.702252:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.702266:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecc72 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c185 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.702302:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074933.702312:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702320:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702333:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074933.702340:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702346:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702375:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702381:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702386:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702391:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.702394:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702400:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702411:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.702413:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.702416:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702421:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fecc79 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702430:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702434:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702438:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702443:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.702446:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702451:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702458:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604ec3c800) 00010000:00010000:1.0:1769074933.702460:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.702463:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702468:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecc80 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.702488:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecc72 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c185 expref: 448 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.702497:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.702499:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074933.702503:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecc72 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c185 expref: 448 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.702511:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2c00, rc -2) 00000100:00100000:1.0:1769074933.702590:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:2418:x1855007616214656:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 361us (1610us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074933.702597:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 283 00000100:00100000:0.0:1769074933.710695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.710856:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214784 00000100:00100000:2.0:1769074933.710867:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214784 00000100:00100000:2.0:1769074933.710928:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9796 00000100:00100000:2.0:1769074933.710937:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67860:x1855007616214784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.710959:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.710978:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c18c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.711076:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.711093:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711107:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711122:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.711130:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711136:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711202:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711210:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711217:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711223:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711229:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.711234:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711241:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711254:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.711257:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.711262:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711267:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98fecc8e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711281:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711287:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711292:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711298:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.711300:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711306:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711312:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:2.0:1769074933.711314:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.711317:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711322:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecc95 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.711352:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc87 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c18c expref: 448 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.711362:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.711364:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.711368:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fecc87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c18c expref: 448 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.711376:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074933.711442:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67860:x1855007616214784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 506us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.711450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9796 00000100:00100000:2.0:1769074933.732123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.732238:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616214912 00000100:00100000:0.0:1769074933.732249:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616214912 00000100:00100000:0.0:1769074933.732311:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9797 00000100:00100000:0.0:1769074933.732321:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67861:x1855007616214912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074933.732344:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.732366:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fecc9c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c193 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.732433:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.732447:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732458:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732478:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.732484:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732502:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732599:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732606:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732612:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732618:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732625:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.732628:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732635:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732647:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.732651:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.732655:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732662:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecca3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732677:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732683:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732688:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732693:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.732695:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732700:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732707:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff916052ae5300) 00010000:00010000:0.0:1769074933.732710:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.732712:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732717:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98feccaa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.732745:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fecc9c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c193 expref: 448 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.732754:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.732756:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.732760:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fecc9c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c193 expref: 448 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.732774:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef200, rc 0) 00000100:00100000:0.0:1769074933.732836:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67861:x1855007616214912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 517us (724us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.732843:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9797 00000100:00100000:1.0:1769074933.737671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.737799:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215040 00000100:00100000:2.0:1769074933.737809:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215040 00000100:00100000:2.0:1769074933.737866:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9798 00000100:00100000:2.0:1769074933.737876:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67861:x1855007616215040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.737906:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.737927:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccb1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c19a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.737991:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.738014:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738026:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738042:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.738048:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738055:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738111:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738118:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738124:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738133:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738139:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.738144:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738151:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738163:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.738178:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.738184:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738203:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738209:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738214:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738218:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.738220:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738226:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738236:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:2.0:1769074933.738238:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.738241:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738246:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccbf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.738272:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccb1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c19a expref: 448 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.738281:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.738283:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.738286:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccb1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c19a expref: 448 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.738294:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:2.0:1769074933.738354:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67861:x1855007616215040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 479us (691us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.738360:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9798 00000100:00100000:0.0:1769074933.743160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.743240:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215296 00000100:00100000:2.0:1769074933.743252:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215296 00000100:00100000:2.0:1769074933.743318:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9799 00000100:00100000:2.0:1769074933.743326:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:67861:x1855007616215296:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.743352:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.743376:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98feccc6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1a1 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.743504:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.743520:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.743576:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.743592:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.743599:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.743605:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00000004:00080000:2.0:1769074933.744204:0:25081:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd5:0x0], index 1: 0 00010000:00010000:2.0:1769074933.744358:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccdb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.744369:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccdb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744377:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccdb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744412:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744418:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744428:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744434:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744440:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.744444:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744452:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744465:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.744468:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.744472:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744478:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecccd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00000004:00010000:2.0:1769074933.744490:0:25081:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1b9a6e4 reply state 00000000fccd2373 transno 4294969156 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744500:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.744506:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:2.0:1769074933.744508:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074933.744511:0:25081:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074933.745376:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98feccc6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a1 expref: 450 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.745404:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422400/0x557988ac98feccdb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a1 expref: 449 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.745413:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b3:0x0].0x0 (ffff91604e58c500) 00010000:00010000:2.0:1769074933.745415:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074933.745418:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422400, rc 0) 00000100:00100000:2.0:1769074933.745502:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+450:67861:x1855007616215296:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2166us (2340us total) trans 4294969156 rc 0/0 00000100:00100000:2.0:1769074933.745512:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9799 00000100:00100000:1.0:1769074933.751723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.751816:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215424 00000100:00100000:2.0:1769074933.751827:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215424 00000100:00100000:2.0:1769074933.751886:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2845 00000100:00100000:2.0:1769074933.751904:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616215424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.751927:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.751948:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1a8 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074933.751971:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074933.751990:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.751993:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.752002:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.752029:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 221 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.752046:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:2.0:1769074933.752111:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2420:x1855007616215424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074933.752119:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2845 00000100:00100000:1.0:1769074933.756595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.756681:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215552 00000100:00100000:3.0:1769074933.756692:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215552 00000100:00100000:3.0:1769074933.756749:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2846 00000100:00100000:3.0:1769074933.756760:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:67861:x1855007616215552:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074933.756779:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.756797:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1af expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.756829:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 222 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.756838:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.756840:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074933.756844:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1af expref: 222 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.756877:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 222 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074933.756899:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 222 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:3.0:1769074933.756918:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626643968:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074933.757034:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074933.760509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.760724:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215680 00000100:00100000:1.0:1769074933.760734:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215680 00010000:00010000:1.0:1769074933.760787:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 223 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:1.0:1769074933.760827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1949 00000100:00100000:1.0:1769074933.760836:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2420:x1855007616215680:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074933.760850:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074933.760871:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 223 pid: 25313 timeout: 2023 lvb_type: 1 00010000:00010000:1.0:1769074933.760885:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 223 pid: 25313 timeout: 2023 lvb_type: 1 00010000:00010000:1.0:1769074933.760927:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.760929:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.760937:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1af expref: 223 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.760947:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1af expref: 223 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.760987:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1af expref: 223 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074933.761000:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043558700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626644096:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074933.761092:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f900 going to sleep for 11 seconds 00010000:00010000:3.0:1769074933.762121:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f422000/0x557988ac98fecce9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1a8 expref: 223 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:3.0:1769074933.762138:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626643968:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074933.762161:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916052adbe00/0x557988ac98feccf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1af expref: 222 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.762184:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052adbe00, rc 0) 00000100:00100000:3.0:1769074933.762233:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:67861:x1855007616215552:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5475us (5647us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074933.762241:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2846 00000100:00100000:0.0:1769074933.768274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.768437:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616215936 00000100:00100000:2.0:1769074933.768447:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616215936 00000100:00100000:2.0:1769074933.768507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1934 00000100:00100000:2.0:1769074933.768516:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+450:67861:x1855007616215936:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074933.768831:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67861:x1855007616215936:12345-192.168.204.32@tcp:35:cp.0 Request processed in 315us (566us total) trans 4294969157 rc 0/0 00000100:00100000:2.0:1769074933.768839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1934 00000100:00100000:1.0:1769074933.769590:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043558700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626644096:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074933.769611:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074933.769664:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2420:x1855007616215680:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8828us (9173us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.769674:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1949 00000100:00100000:0.0:1769074933.823525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.823802:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216064 00000100:00100000:2.0:1769074933.823814:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216064 00000100:00100000:2.0:1769074933.823877:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9800 00000100:00100000:2.0:1769074933.823889:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67865:x1855007616216064:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074933.823920:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.823947:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98feccf7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1b6 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.824061:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.824080:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824092:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824110:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074933.824117:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824124:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824189:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824197:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824203:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824210:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824217:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.824221:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824228:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824241:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.824244:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.824249:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824254:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98feccfe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824269:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824275:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824281:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824286:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.824289:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824295:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824301:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58c100) 00010000:00010000:2.0:1769074933.824304:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.824307:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824312:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd05 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074933.824342:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98feccf7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1b6 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.824353:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.824356:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.824360:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98feccf7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1b6 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.824373:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:2.0:1769074933.824448:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67865:x1855007616216064:12345-192.168.204.32@tcp:101:bash.0 Request processed in 560us (932us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.824455:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9800 00000100:00100000:2.0:1769074933.840678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.840726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074933.840802:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216320 00000100:00100000:3.0:1769074933.840812:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216320 00000100:00100000:3.0:1769074933.840870:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 284 00000100:00100000:3.0:1769074933.840880:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:2420:x1855007616216320:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074933.840929:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074933.840949:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fecd0c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1c4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.841017:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074933.841034:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841045:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841059:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074933.841065:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841070:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841126:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841133:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841139:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841145:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.841149:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841156:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841178:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.841182:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.841187:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841192:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecd13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841205:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841211:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841215:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841221:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074933.841224:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841229:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841236:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x41eab4ef (ffff91604ec2fc00) 00010000:00010000:3.0:1769074933.841239:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074933.841241:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841247:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49600/0x557988ac98fecd1a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074933.841273:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fecd0c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1c4 expref: 452 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.841281:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074933.841284:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074933.841287:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fecd0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1c4 expref: 452 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074933.841301:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc -2) 00000100:00100000:3.0:1769074933.841377:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:2420:x1855007616216320:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 497us (649us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074933.841384:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 284 00000100:00100000:0.0:1769074933.842204:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216192 00000100:00100000:0.0:1769074933.842212:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216192 00000100:00100000:0.0:1769074933.842261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9801 00000100:00100000:0.0:1769074933.842271:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67866:x1855007616216192:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074933.842284:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.842298:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecd21 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.842353:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.842366:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842375:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842388:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074933.842395:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842402:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842440:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842446:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842452:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842457:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842463:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.842466:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842472:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842482:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.842485:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.842488:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842494:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecd28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842504:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842510:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842517:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842522:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.842525:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842565:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842571:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff916052ae5300) 00010000:00010000:0.0:1769074933.842574:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.842577:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842583:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fecd2f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074933.842607:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecd21 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1bd expref: 452 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.842616:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.842619:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.842622:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecd21 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1bd expref: 452 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.842630:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074933.842677:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67866:x1855007616216192:12345-192.168.204.32@tcp:101:rm.0 Request processed in 408us (2008us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.842683:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9801 00000100:00100000:2.0:1769074933.849812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.849892:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216448 00000100:00100000:0.0:1769074933.849903:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216448 00000100:00100000:0.0:1769074933.849966:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9802 00000100:00100000:0.0:1769074933.849976:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67866:x1855007616216448:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074933.849997:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.850030:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd36 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1cb expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.850102:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.850116:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850128:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850140:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.850146:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850152:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850215:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850221:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850227:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850237:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850241:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.850245:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850251:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850263:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.850266:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.850270:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850276:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850290:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850295:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850301:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850306:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.850309:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850314:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850325:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff916052ae5900) 00010000:00010000:0.0:1769074933.850327:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.850330:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850335:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd44 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.850364:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd36 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1cb expref: 452 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.850374:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.850376:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.850380:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd36 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1cb expref: 452 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.850390:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc 0) 00000100:00100000:0.0:1769074933.850457:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67866:x1855007616216448:12345-192.168.204.32@tcp:101:rm.0 Request processed in 482us (659us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.850464:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9802 00000100:00100000:3.0:1769074933.871607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.871966:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216576 00000100:00100000:2.0:1769074933.871976:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216576 00000100:00100000:2.0:1769074933.872049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9803 00000100:00100000:2.0:1769074933.872059:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67867:x1855007616216576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.872084:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.872105:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.872182:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.872198:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872209:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872223:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.872230:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872242:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872294:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872300:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872307:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872313:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872319:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.872324:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872331:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.872347:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.872351:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872358:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd52 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872372:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872379:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872386:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872392:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.872394:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872399:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872407:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58c100) 00010000:00010000:2.0:1769074933.872409:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.872412:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872417:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd59 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.872447:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd4b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1d2 expref: 452 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.872456:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.872459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.872463:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1d2 expref: 452 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.872472:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:2.0:1769074933.872593:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67867:x1855007616216576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 534us (996us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.872601:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9803 00000100:00100000:3.0:1769074933.876666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.876744:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216704 00000100:00100000:0.0:1769074933.876753:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216704 00000100:00100000:0.0:1769074933.876803:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9804 00000100:00100000:0.0:1769074933.876812:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67867:x1855007616216704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074933.876832:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.876851:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1d9 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.876936:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.876950:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.876961:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.876976:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.876983:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.876990:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877049:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877056:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877061:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877066:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877071:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.877075:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877085:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877096:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.877098:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.877103:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877108:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecd67 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877120:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877124:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877129:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877133:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.877135:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877140:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877146:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff916052ae5900) 00010000:00010000:0.0:1769074933.877148:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.877150:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877156:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecd6e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.877195:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd60 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1d9 expref: 452 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.877204:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.877207:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.877210:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecd60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1d9 expref: 452 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.877218:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc 0) 00000100:00100000:0.0:1769074933.877279:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67867:x1855007616216704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 467us (621us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.877286:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9804 00000100:00100000:1.0:1769074933.884161:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.884269:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616216960 00000100:00100000:2.0:1769074933.884280:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616216960 00000100:00100000:2.0:1769074933.884340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9805 00000100:00100000:2.0:1769074933.884350:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:67867:x1855007616216960:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.884372:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.884393:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd75 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.884526:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.884577:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.884587:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.884604:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.884612:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.884630:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074933.884935:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd5:0x0], index 0: 0 00010000:00010000:2.0:1769074933.885091:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fecd8a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.885101:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fecd8a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885108:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fecd8a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885141:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885148:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885154:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885160:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885165:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.885170:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885176:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885188:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.885191:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.885196:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885202:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecd7c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074933.885215:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000370753b7 reply state 00000000e509e7f6 transno 4294969158 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885225:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.885231:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58c100) 00010000:00010000:2.0:1769074933.885234:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074933.885236:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074933.885266:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fecd75 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e0 expref: 454 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.885281:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281000/0x557988ac98fecd8a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e0 expref: 453 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.885287:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b4:0x0].0x0 (ffff91604e58cd00) 00010000:00010000:2.0:1769074933.885290:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074933.885293:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e281000, rc 0) 00000100:00100000:2.0:1769074933.885362:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+454:67867:x1855007616216960:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1013us (1213us total) trans 4294969158 rc 0/0 00000100:00100000:2.0:1769074933.885370:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9805 00000100:00100000:3.0:1769074933.891493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.891628:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217088 00000100:00100000:1.0:1769074933.891638:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217088 00000100:00100000:1.0:1769074933.891693:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2847 00000100:00100000:1.0:1769074933.891703:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2420:x1855007616217088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074933.891719:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.891741:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1e7 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074933.891766:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074933.891787:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.891789:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.891797:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.891815:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074933.891827:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3e00, rc 0) 00000100:00100000:1.0:1769074933.891884:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2420:x1855007616217088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 182us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.891900:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2847 00000100:00100000:3.0:1769074933.896759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.897113:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217216 00000100:00100000:2.0:1769074933.897125:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217216 00000100:00100000:2.0:1769074933.897190:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2848 00000100:00100000:2.0:1769074933.897200:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:67867:x1855007616217216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074933.897218:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.897235:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1ee expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.897265:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.897274:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.897277:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074933.897281:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1ee expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.897321:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074933.897336:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 224 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074933.897350:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626644224:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074933.897449:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff9160449dc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074933.901723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.901875:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217344 00000100:00100000:1.0:1769074933.901885:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217344 00010000:00010000:1.0:1769074933.901946:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:1.0:1769074933.901988:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1950 00000100:00100000:1.0:1769074933.901997:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616217344:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074933.902022:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074933.902045:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:1.0:1769074933.902061:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:1.0:1769074933.902087:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.902089:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074933.902097:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1ee expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.902107:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1ee expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.902142:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1ee expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074933.902155:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043559880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626644352:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074933.902477:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f900 going to sleep for 11 seconds 00010000:00010000:2.0:1769074933.903305:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3e00/0x557988ac98fecd98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1e7 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074933.903323:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626644224:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074933.903348:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604e280400/0x557988ac98fecd9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1ee expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.903360:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e280400, rc 0) 00000100:00100000:2.0:1769074933.903412:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67867:x1855007616217216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6212us (6663us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074933.903421:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2848 00000100:00100000:1.0:1769074933.909041:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043559880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626644352:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074933.909073:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074933.909132:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616217344:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7135us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074933.909142:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1950 00000100:00100000:3.0:1769074933.912998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.913104:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217600 00000100:00100000:1.0:1769074933.913113:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217600 00000100:00100000:1.0:1769074933.913172:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1935 00000100:00100000:1.0:1769074933.913181:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+454:67867:x1855007616217600:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074933.913480:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67867:x1855007616217600:12345-192.168.204.32@tcp:35:cp.0 Request processed in 299us (491us total) trans 4294969159 rc 0/0 00000100:00100000:1.0:1769074933.913488:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1935 00010000:00010000:1.0:1769074933.939832:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074933.955212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.955368:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217728 00000100:00100000:0.0:1769074933.955379:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217728 00000100:00100000:0.0:1769074933.955444:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9806 00000100:00100000:0.0:1769074933.955454:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67870:x1855007616217728:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074933.955475:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.955496:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecda6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1f5 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.955600:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.955627:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955641:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955661:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.955668:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955674:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955744:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955753:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955758:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955764:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955770:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.955773:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955780:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955791:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.955795:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.955800:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955805:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955819:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955824:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955828:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955833:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.955835:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955841:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955848:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff916052ae5900) 00010000:00010000:0.0:1769074933.955850:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.955853:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955859:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecdb4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.955888:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecda6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1f5 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.955897:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.955899:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.955903:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fecda6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1f5 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.955917:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc 0) 00000100:00100000:0.0:1769074933.955982:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67870:x1855007616217728:12345-192.168.204.32@tcp:101:bash.0 Request processed in 529us (780us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.955988:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9806 00000100:00100000:3.0:1769074933.971876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074933.972174:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217856 00000100:00100000:2.0:1769074933.972185:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217856 00000100:00100000:2.0:1769074933.972248:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9807 00000100:00100000:2.0:1769074933.972258:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67871:x1855007616217856:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074933.972285:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074933.972331:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdbb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c1fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.972401:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.972417:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972430:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972444:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074933.972451:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972457:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972524:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972566:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972573:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972579:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972585:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.972589:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972596:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.972624:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.972629:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972635:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fecdc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972648:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972652:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972658:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972662:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074933.972665:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972670:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972676:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff91604e58cb00) 00010000:00010000:2.0:1769074933.972678:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.972680:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972684:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fecdc9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074933.972715:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdbb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1fc expref: 456 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.972724:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074933.972727:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074933.972730:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdbb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c1fc expref: 456 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074933.972739:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074933.972801:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67871:x1855007616217856:12345-192.168.204.32@tcp:101:rm.0 Request processed in 544us (936us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074933.972808:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9807 00000100:00100000:3.0:1769074933.977589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074933.977706:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616217984 00000100:00100000:1.0:1769074933.977717:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616217984 00000100:00100000:1.0:1769074933.977776:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 285 00000100:00100000:1.0:1769074933.977786:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:2420:x1855007616217984:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074933.977825:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074933.977845:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecdd0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c203 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.977913:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074933.977929:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.977940:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.977954:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074933.977961:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.977967:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978029:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978036:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978041:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978048:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.978051:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978059:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978072:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.978075:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.978080:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978085:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecdd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978097:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978102:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978107:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978111:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074933.978114:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978119:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978125:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604ec3c400) 00010000:00010000:1.0:1769074933.978127:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074933.978130:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978134:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecdde lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074933.978159:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecdd0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c203 expref: 456 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.978181:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074933.978183:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074933.978187:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fecdd0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c203 expref: 456 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074933.978196:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc -2) 00000100:00100000:1.0:1769074933.978255:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:2420:x1855007616217984:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 470us (677us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074933.978261:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 285 00000100:00100000:3.0:1769074933.982059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074933.982815:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218112 00000100:00100000:0.0:1769074933.982827:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218112 00000100:00100000:0.0:1769074933.982902:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9808 00000100:00100000:0.0:1769074933.982913:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67871:x1855007616218112:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074933.982933:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074933.982954:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecde5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c20a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.983033:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.983051:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983063:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983078:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074933.983084:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983090:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983903:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983913:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983919:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983925:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983930:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.983933:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983940:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983952:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.983955:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.983960:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983966:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fecdec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983979:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983984:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983989:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.983994:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074933.983997:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.984013:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.984020:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff916052ae5900) 00010000:00010000:0.0:1769074933.984023:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.984026:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.984032:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fecdf3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074933.984068:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecde5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c20a expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.984077:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074933.984080:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074933.984083:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fecde5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c20a expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074933.984091:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eec00, rc 0) 00000100:00100000:0.0:1769074933.984435:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67871:x1855007616218112:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1522us (2385us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074933.984443:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9808 00000100:00100000:0.0:1769074934.000748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.000927:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218240 00000100:00100000:2.0:1769074934.000937:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218240 00000100:00100000:2.0:1769074934.000998:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9809 00000100:00100000:2.0:1769074934.001019:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67872:x1855007616218240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.001042:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.001063:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdfa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c211 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.001127:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.001142:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001153:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001400:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.001407:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001412:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001463:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001470:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001475:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001481:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001486:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.001490:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001510:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001521:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.001524:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.001612:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001619:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001634:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001639:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001645:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001650:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.001653:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001659:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001667:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff91604e58cb00) 00010000:00010000:2.0:1769074934.001670:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.001673:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001677:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.001708:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdfa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c211 expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.001718:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.001721:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.001724:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fecdfa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c211 expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.001737:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074934.001851:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67872:x1855007616218240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 833us (1112us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.001859:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9809 00000100:00100000:3.0:1769074934.007761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.007854:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218368 00000100:00100000:2.0:1769074934.007864:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218368 00000100:00100000:2.0:1769074934.007933:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9810 00000100:00100000:2.0:1769074934.007943:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67872:x1855007616218368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.007963:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.007983:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c218 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.008061:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.008075:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008087:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008100:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.008107:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008113:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008181:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008188:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008194:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008200:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008206:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.008210:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008217:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008228:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.008231:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.008236:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008241:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fece16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008253:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008259:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008264:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008271:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.008273:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008279:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008285:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff91604e58cb00) 00010000:00010000:2.0:1769074934.008287:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.008290:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008295:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fece1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.008324:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece0f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c218 expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.008334:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.008336:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.008339:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c218 expref: 456 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.008348:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074934.008413:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67872:x1855007616218368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 471us (663us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.008420:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9810 00000100:00100000:2.0:1769074934.013833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.013945:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218624 00000100:00100000:0.0:1769074934.013957:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218624 00000100:00100000:0.0:1769074934.014023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9811 00000100:00100000:0.0:1769074934.014033:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:67872:x1855007616218624:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.014054:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.014075:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fece24 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c21f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.014208:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.014223:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014234:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014250:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.014257:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014262:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074934.014525:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd6:0x0], index 1: 0 00010000:00010000:0.0:1769074934.014698:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fece39 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.014707:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fece39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014714:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fece39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014742:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014749:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014755:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014784:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014790:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.014794:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014801:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014811:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.014814:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.014818:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014824:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fece2b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074934.014835:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000553d7b4c reply state 00000000e98c2521 transno 4294969160 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014844:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.014850:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff916052ae5900) 00010000:00010000:0.0:1769074934.014853:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074934.014855:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074934.014883:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fece24 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c21f expref: 458 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.014896:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee600/0x557988ac98fece39 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c21f expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.014904:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b5:0x0].0x0 (ffff916052ae5300) 00010000:00010000:0.0:1769074934.014906:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074934.014908:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee600, rc 0) 00000100:00100000:0.0:1769074934.014959:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+458:67872:x1855007616218624:12345-192.168.204.32@tcp:101:cp.0 Request processed in 928us (1136us total) trans 4294969160 rc 0/0 00000100:00100000:0.0:1769074934.014966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9811 00000100:00100000:3.0:1769074934.020619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.020755:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218752 00000100:00100000:2.0:1769074934.020766:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218752 00000100:00100000:2.0:1769074934.020829:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2849 00000100:00100000:2.0:1769074934.020839:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2417:x1855007616218752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.020856:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.020877:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c226 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074934.020909:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074934.020929:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.020931:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.020940:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 222 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.020956:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 222 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.020969:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074934.021046:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2417:x1855007616218752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.021054:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2849 00000100:00100000:1.0:1769074934.025935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.026122:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616218880 00000100:00100000:3.0:1769074934.026133:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616218880 00000100:00100000:3.0:1769074934.026203:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2850 00000100:00100000:3.0:1769074934.026213:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:67872:x1855007616218880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074934.026230:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074934.026248:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c22d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.026279:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 223 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074934.026293:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074934.026295:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074934.026299:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c22d expref: 223 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.026334:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 223 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074934.026348:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 223 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:3.0:1769074934.026361:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626644480:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074934.026605:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604b4c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1769074934.031598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.032482:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219008 00000100:00100000:0.0:1769074934.032503:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219008 00010000:00010000:0.0:1769074934.032686:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 224 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:0.0:1769074934.032732:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1951 00000100:00100000:0.0:1769074934.032742:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614c09c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2420:x1855007616219008:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074934.032756:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074934.032774:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 224 pid: 25313 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.032788:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 224 pid: 25313 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.032822:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.032824:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.032831:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c22d expref: 224 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.032841:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c22d expref: 224 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.032879:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c22d expref: 224 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074934.032991:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626644608:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074934.033189:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae60c0 going to sleep for 11 seconds 00010000:00010000:1.0:1769074934.033432:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fece47 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c226 expref: 224 pid: 25313 timeout: 2023 lvb_type: 1 00000100:00100000:1.0:1769074934.033448:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1855007626644480:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074934.033473:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff916174a49600/0x557988ac98fece4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c22d expref: 223 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.033483:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916174a49600, rc 0) 00000100:00100000:1.0:1769074934.033525:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:67872:x1855007616218880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 7314us (7600us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.033570:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2850 00000100:00100000:0.0:1769074934.043702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.043840:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626644608:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074934.043866:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074934.044062:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614c09c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2420:x1855007616219008:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 11320us (12472us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.044074:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1951 00000100:00100000:3.0:1769074934.044509:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219264 00000100:00100000:3.0:1769074934.044517:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219264 00000100:00100000:3.0:1769074934.044591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1936 00000100:00100000:3.0:1769074934.044600:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+458:67872:x1855007616219264:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074934.047796:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67872:x1855007616219264:12345-192.168.204.32@tcp:35:cp.0 Request processed in 3182us (4091us total) trans 4294969161 rc 0/0 00000100:00100000:3.0:1769074934.047813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1936 00000100:00100000:0.0:1769074934.087864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.088136:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219392 00000100:00100000:2.0:1769074934.088147:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219392 00000100:00100000:2.0:1769074934.088206:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9812 00000100:00100000:2.0:1769074934.088215:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67875:x1855007616219392:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074934.088236:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.088258:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fece55 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c234 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.088339:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.088354:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088365:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088379:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:2.0:1769074934.088387:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088394:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088445:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088453:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088459:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088465:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088472:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.088476:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088483:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088494:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.088497:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.088502:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088508:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088523:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088579:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088586:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088591:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.088594:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088600:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088607:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff91604e58c200) 00010000:00010000:2.0:1769074934.088610:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.088614:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088619:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece63 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:2.0:1769074934.088650:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fece55 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c234 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.088659:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.088661:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.088665:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fece55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c234 expref: 7 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.088675:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ee00, rc 0) 00000100:00100000:2.0:1769074934.089046:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67875:x1855007616219392:12345-192.168.204.32@tcp:101:bash.0 Request processed in 830us (1192us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.089054:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9812 00000100:00100000:2.0:1769074934.102692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.102795:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219520 00000100:00100000:0.0:1769074934.102805:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219520 00000100:00100000:0.0:1769074934.102862:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9813 00000100:00100000:0.0:1769074934.102872:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67876:x1855007616219520:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.102897:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.102918:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fece6a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c23b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.102986:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.103012:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103024:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103039:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.103045:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103052:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103104:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103111:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103117:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103122:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103128:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.103132:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103140:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103151:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.103155:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.103159:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103165:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fece71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103180:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103186:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103192:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103201:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.103204:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103210:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103216:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff916052ae5600) 00010000:00010000:0.0:1769074934.103218:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.103220:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103225:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fece78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.103255:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fece6a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c23b expref: 460 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.103263:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.103266:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.103269:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fece6a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c23b expref: 460 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.103278:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee800, rc 0) 00000100:00100000:0.0:1769074934.103337:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67876:x1855007616219520:12345-192.168.204.32@tcp:101:rm.0 Request processed in 466us (653us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.103345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9813 00000100:00100000:3.0:1769074934.103626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.103786:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219648 00000100:00100000:2.0:1769074934.103792:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219648 00000100:00100000:2.0:1769074934.103831:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 286 00000100:00100000:2.0:1769074934.103839:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:2419:x1855007616219648:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.103891:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.103903:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece7f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c242 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.103939:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.103953:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.103961:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.103974:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.103980:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.103987:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104028:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104034:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104039:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104043:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.104045:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104051:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104059:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.104061:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.104064:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104069:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fece86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104079:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104085:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104090:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104094:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.104097:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104101:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104108:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604e58c200) 00010000:00010000:2.0:1769074934.104110:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.104113:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104117:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fece8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.104139:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece7f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c242 expref: 460 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.104146:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.104149:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.104152:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fece7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c242 expref: 460 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.104159:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc -2) 00000100:00100000:2.0:1769074934.104201:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:2419:x1855007616219648:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 361us (574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.104208:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 286 00000100:00100000:2.0:1769074934.106397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.106485:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219776 00000100:00100000:0.0:1769074934.106862:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219776 00000100:00100000:0.0:1769074934.107057:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9814 00000100:00100000:0.0:1769074934.107067:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67876:x1855007616219776:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.107086:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.107107:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fece94 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c27a expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.107169:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074934.107182:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107192:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107205:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074934.107211:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107217:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107266:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107273:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107278:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107284:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107290:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.107294:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107302:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107313:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.107316:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.107321:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107327:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fece9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107340:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107345:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107350:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107355:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.107358:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107363:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107368:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff916052ae5700) 00010000:00010000:0.0:1769074934.107370:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.107373:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107378:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecea2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.107407:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fece94 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c27a expref: 460 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.107416:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.107418:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.107422:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fece94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c27a expref: 460 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.107430:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee200, rc 0) 00000100:00100000:0.0:1769074934.107506:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67876:x1855007616219776:12345-192.168.204.32@tcp:101:rm.0 Request processed in 440us (1116us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.107514:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9814 00000100:00100000:2.0:1769074934.134934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.134934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.135049:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220032 00000100:00100000:1.0:1769074934.135059:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220032 00000100:00100000:1.0:1769074934.135116:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 287 00000100:00100000:1.0:1769074934.135126:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:2417:x1855007616220032:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074934.135191:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.135210:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecea9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c288 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.135269:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.135283:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135294:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135311:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.135318:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135324:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135377:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135385:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135392:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135397:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.135402:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135409:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135420:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.135423:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.135427:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135432:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98feceb0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135445:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135449:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135454:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135459:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.135462:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135466:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135477:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604ec3c400) 00010000:00010000:1.0:1769074934.135479:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.135482:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135487:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98feceb7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.135800:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecea9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c288 expref: 460 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.135809:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.135811:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074934.135815:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecea9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c288 expref: 460 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.135822:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2600, rc -2) 00000100:00100000:1.0:1769074934.135878:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:2417:x1855007616220032:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 753us (954us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074934.135886:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 287 00000100:00100000:0.0:1769074934.138067:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616219904 00000100:00100000:0.0:1769074934.138080:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616219904 00000100:00100000:0.0:1769074934.138195:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9815 00000100:00100000:0.0:1769074934.138206:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67879:x1855007616219904:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.138225:0:25081:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.138244:0:25081:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecebe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c281 expref: -99 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.138305:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074934.138330:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138342:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138357:0:25081:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25081 initiator: MDT0 00010000:00010000:0.0:1769074934.138364:0:25081:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138371:0:25081:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138419:0:25081:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138427:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138433:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138440:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138447:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.138452:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138459:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138469:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.138473:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.138476:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138482:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecec5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138494:0:25081:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138500:0:25081:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138506:0:25081:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138510:0:25081:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.138513:0:25081:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138518:0:25081:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138524:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff916052ae5700) 00010000:00010000:0.0:1769074934.138527:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.138546:0:25081:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138551:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fececc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:0.0:1769074934.138580:0:25081:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecebe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c281 expref: 460 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.138590:0:25081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.138592:0:25081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.138595:0:25081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecebe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c281 expref: 460 pid: 25081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.138604:0:25081:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee200, rc 0) 00000100:00100000:0.0:1769074934.138677:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67879:x1855007616219904:12345-192.168.204.32@tcp:101:cp.0 Request processed in 473us (3751us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.138685:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9815 00000100:00100000:3.0:1769074934.142608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.156735:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220160 00000100:00100000:2.0:1769074934.156751:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220160 00000100:00100000:2.0:1769074934.156844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9816 00000100:00100000:2.0:1769074934.156854:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67879:x1855007616220160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.157484:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.157508:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feced3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c2c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.157594:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.157609:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157620:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157634:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.157641:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157649:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157704:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157711:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157717:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157723:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157729:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.157734:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157742:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.157756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.157761:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157767:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98feceda lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157781:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157786:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157792:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157797:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.157799:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157805:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157810:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff91604e58c200) 00010000:00010000:2.0:1769074934.157812:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.157815:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157820:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fecee1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.157846:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feced3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2c0 expref: 460 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.157854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.157856:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.158982:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feced3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2c0 expref: 460 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.159014:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074934.159097:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67879:x1855007616220160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2241us (16497us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.159105:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9816 00000100:00100000:2.0:1769074934.169056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.169155:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220416 00000100:00100000:1.0:1769074934.169175:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220416 00000100:00100000:1.0:1769074934.169233:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9817 00000100:00100000:1.0:1769074934.169243:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:67879:x1855007616220416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.169263:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.169284:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecee8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c2c7 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.169413:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.169428:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.169440:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.169454:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.169459:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.169465:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074934.169854:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd6:0x0], index 0: 0 00010000:00010000:1.0:1769074934.170019:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecefd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.170029:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170036:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170069:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170075:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170085:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170091:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.170095:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170102:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170114:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.170117:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.170123:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170128:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98feceef lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074934.170139:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e4c37cfd reply state 00000000e437d3d5 transno 4294969162 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170149:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.170155:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff91604ec3ce00) 00010000:00010000:1.0:1769074934.170157:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074934.170160:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074934.170190:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2c00/0x557988ac98fecee8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2c7 expref: 462 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.170203:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2600/0x557988ac98fecefd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2c7 expref: 461 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.170217:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b6:0x0].0x0 (ffff91604ec3c400) 00010000:00010000:1.0:1769074934.170219:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074934.170222:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2600, rc 0) 00000100:00100000:1.0:1769074934.170282:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+462:67879:x1855007616220416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1041us (1236us total) trans 4294969162 rc 0/0 00000100:00100000:1.0:1769074934.170290:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9817 00000100:00100000:2.0:1769074934.175380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.175426:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220544 00000100:00100000:1.0:1769074934.175437:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220544 00000100:00100000:1.0:1769074934.175668:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2851 00000100:00100000:1.0:1769074934.175678:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2420:x1855007616220544:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.175697:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.175718:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c2ce expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074934.175742:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074934.175762:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.175765:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.175774:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.175789:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.175801:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3600, rc 0) 00000100:00100000:1.0:1769074934.175860:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2420:x1855007616220544:12345-192.168.204.32@tcp:101:cp.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.175871:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2851 00000100:00100000:3.0:1769074934.180736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.180808:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220672 00000100:00100000:1.0:1769074934.180821:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220672 00000100:00100000:1.0:1769074934.181035:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2852 00000100:00100000:1.0:1769074934.181046:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67879:x1855007616220672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.181065:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.181083:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c2d5 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.181113:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 225 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.181121:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.181122:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.181126:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2d5 expref: 225 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.181170:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 225 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.181183:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:1.0:1769074934.181197:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043558e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8406:1855007626644736:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074934.181354:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f780 going to sleep for 11 seconds 00000100:00100000:3.0:1769074934.184752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.184854:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616220800 00000100:00100000:2.0:1769074934.184863:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616220800 00010000:00010000:2.0:1769074934.185021:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 226 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074934.185062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1952 00000100:00100000:2.0:1769074934.185072:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616220800:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074934.185086:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074934.185107:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 226 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:2.0:1769074934.185121:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 226 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:2.0:1769074934.185145:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.185147:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.185155:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2d5 expref: 226 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.185246:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2d5 expref: 226 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.185287:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2d5 expref: 226 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074934.185302:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f970000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626644864:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074934.185391:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ed0e40 going to sleep for 11 seconds 00010000:00010000:1.0:1769074934.186048:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3600/0x557988ac98fecf0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2ce expref: 226 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:1.0:1769074934.186064:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043558e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8406:1855007626644736:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074934.186087:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2c00/0x557988ac98fecf12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2d5 expref: 225 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.186097:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2c00, rc 0) 00000100:00100000:1.0:1769074934.186145:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:67879:x1855007616220672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5101us (5416us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.186153:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2852 00000100:00100000:2.0:1769074934.190166:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f970000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626644864:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074934.190193:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074934.190273:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616220800:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5201us (5529us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.190284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1952 00000100:00100000:3.0:1769074934.194380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.194985:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221056 00000100:00100000:2.0:1769074934.195011:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221056 00000100:00100000:2.0:1769074934.195220:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1937 00000100:00100000:2.0:1769074934.195232:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+462:67879:x1855007616221056:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074934.197281:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67879:x1855007616221056:12345-192.168.204.32@tcp:35:cp.0 Request processed in 2029us (2893us total) trans 4294969163 rc 0/0 00000100:00100000:2.0:1769074934.197298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1937 00000100:00100000:0.0:1769074934.235475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.235606:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221184 00000100:00100000:3.0:1769074934.235620:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221184 00000100:00100000:3.0:1769074934.235694:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 288 00000100:00100000:3.0:1769074934.235706:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:2419:x1855007616221184:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074934.235798:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074934.235824:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecf19 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c2dc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.235897:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074934.235915:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.235930:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.235950:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074934.235958:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.235964:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236044:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236053:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236065:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236072:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074934.236077:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236086:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236101:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074934.236104:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.236109:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236114:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fecf20 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236129:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236136:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236141:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236147:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074934.236150:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236156:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236180:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604ec2fc00) 00010000:00010000:3.0:1769074934.236182:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.236186:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236191:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fecf27 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074934.236225:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecf19 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2dc expref: 464 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.236235:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074934.236238:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074934.236242:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fecf19 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c2dc expref: 464 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.236252:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423e00, rc -2) 00000100:00100000:3.0:1769074934.236342:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:2419:x1855007616221184:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 638us (882us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074934.236351:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 288 00000100:00100000:3.0:1769074934.245887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.246077:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221312 00000100:00100000:1.0:1769074934.246091:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221312 00000100:00100000:1.0:1769074934.246179:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9818 00000100:00100000:1.0:1769074934.246192:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67886:x1855007616221312:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074934.246220:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.246246:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf2e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c314 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.246333:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.246353:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246366:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246382:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.246394:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246401:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246469:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246477:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246485:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246492:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.246497:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246506:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246520:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.246525:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.246572:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246580:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf35 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246595:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246602:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246609:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246614:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.246617:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246623:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246631:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff91604464e200) 00010000:00010000:1.0:1769074934.246633:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.246636:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246642:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf3c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.246679:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf2e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c314 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.246689:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.246692:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.246695:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf2e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c314 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.246704:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2a00, rc 0) 00000100:00100000:1.0:1769074934.246844:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67886:x1855007616221312:12345-192.168.204.32@tcp:101:bash.0 Request processed in 653us (970us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074934.246853:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9818 00000100:00100000:2.0:1769074934.273401:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.273464:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.273626:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221568 00000100:00100000:1.0:1769074934.273641:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221568 00000100:00100000:1.0:1769074934.273719:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 289 00000100:00100000:1.0:1769074934.273730:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:2419:x1855007616221568:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074934.273784:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.273812:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf43 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c322 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.273889:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.273906:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.273919:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.273933:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.273939:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.273945:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274052:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274060:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274066:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274074:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.274079:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274088:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274102:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.274106:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.274111:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274116:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecf4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274132:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274139:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274145:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274150:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.274153:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274159:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274166:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604464e200) 00010000:00010000:1.0:1769074934.274168:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.274171:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274176:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecf51 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.274211:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf43 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c322 expref: 464 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.274220:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.274223:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074934.274227:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecf43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c322 expref: 464 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.274237:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2a00, rc -2) 00000100:00100000:1.0:1769074934.274327:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:2419:x1855007616221568:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 598us (861us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074934.274335:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 289 00000100:00100000:0.0:1769074934.274482:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221440 00000100:00100000:0.0:1769074934.274488:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221440 00000100:00100000:0.0:1769074934.274577:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9819 00000100:00100000:0.0:1769074934.274587:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67887:x1855007616221440:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.274601:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.274614:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c31b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.274663:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.274679:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274688:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274701:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.274707:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274712:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274744:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274751:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274757:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274763:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.274766:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274772:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274780:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.274783:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.274786:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274791:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf5f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274801:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274807:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274812:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274816:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.274819:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274824:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274830:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff916052ae5700) 00010000:00010000:0.0:1769074934.274833:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.274835:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274841:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf66 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.274864:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf58 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c31b expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.274873:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.274876:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.274880:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c31b expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.274888:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef800, rc 0) 00000100:00100000:0.0:1769074934.274931:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67887:x1855007616221440:12345-192.168.204.32@tcp:101:rm.0 Request processed in 346us (1546us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.274938:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9819 00000100:00100000:2.0:1769074934.280038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.280190:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221696 00000100:00100000:1.0:1769074934.280204:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221696 00000100:00100000:1.0:1769074934.280270:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9820 00000100:00100000:1.0:1769074934.280280:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67887:x1855007616221696:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074934.280305:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.280330:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fecf6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c329 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.280407:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.280425:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.280438:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.280452:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.280458:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.280464:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.280527:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281050:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281058:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281066:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.281070:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281146:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281167:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.281172:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.281178:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281185:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecf74 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281202:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281209:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281215:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281220:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.281222:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281228:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281237:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff91604464e800) 00010000:00010000:1.0:1769074934.281239:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.281241:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281247:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecf7b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.281289:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fecf6d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c329 expref: 464 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.281299:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.281301:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.281305:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fecf6d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c329 expref: 464 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.281319:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074934.281403:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67887:x1855007616221696:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1124us (1380us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074934.281412:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9820 00000100:00100000:2.0:1769074934.303461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.303693:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221824 00000100:00100000:0.0:1769074934.303708:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221824 00000100:00100000:0.0:1769074934.304523:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9821 00000100:00100000:0.0:1769074934.304594:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67888:x1855007616221824:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.304622:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.304650:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c330 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.304734:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.304752:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304765:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304783:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.304790:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304796:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304863:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304870:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304877:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304883:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.304888:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304895:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304909:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.304912:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.304917:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304924:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fecf89 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304938:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304943:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304949:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304954:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.304958:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304964:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304970:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff916052ae5700) 00010000:00010000:0.0:1769074934.304972:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.304974:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.304979:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fecf90 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.305024:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf82 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c330 expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.305035:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.305037:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.305040:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fecf82 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c330 expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.305049:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef800, rc 0) 00000100:00100000:0.0:1769074934.305127:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67888:x1855007616221824:12345-192.168.204.32@tcp:101:cp.0 Request processed in 542us (1683us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.305136:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9821 00000100:00100000:3.0:1769074934.308709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.309150:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616221952 00000100:00100000:0.0:1769074934.309963:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616221952 00000100:00100000:0.0:1769074934.310059:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9822 00000100:00100000:0.0:1769074934.310071:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67888:x1855007616221952:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.310114:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.310142:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fecf97 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c337 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.310384:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.310403:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310416:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310433:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.310439:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310444:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310742:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310751:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310759:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310765:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.310771:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310784:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310800:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.310804:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.310809:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310816:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fecf9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310833:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310839:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310845:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310850:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.310853:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310858:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310864:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff916052ae5600) 00010000:00010000:0.0:1769074934.310867:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.310870:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310875:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fecfa5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.310914:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fecf97 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c337 expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.310924:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.310926:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.310929:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fecf97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c337 expref: 464 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.310937:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074934.311026:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67888:x1855007616221952:12345-192.168.204.32@tcp:101:cp.0 Request processed in 956us (2329us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.311034:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9822 00000100:00100000:2.0:1769074934.320763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.320883:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222208 00000100:00100000:1.0:1769074934.320897:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222208 00000100:00100000:1.0:1769074934.320960:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9823 00000100:00100000:1.0:1769074934.320970:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:67888:x1855007616222208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.321008:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.321035:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfac lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c33e expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.321201:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.321218:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.321232:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.321247:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.321255:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.321261:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00000004:00080000:1.0:1769074934.322330:0:7534:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd7:0x0], index 1: 0 00010000:00010000:1.0:1769074934.325160:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecfc1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.325190:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecfc1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325204:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecfc1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325265:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325272:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325279:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325286:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.325290:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325298:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325311:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.325314:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.325319:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325325:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fecfb3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00000004:00010000:1.0:1769074934.325348:0:7534:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e3368d4 reply state 0000000009736492 transno 4294969164 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325360:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.325366:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff91604464e800) 00010000:00010000:1.0:1769074934.325369:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074934.325372:0:7534:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074934.325421:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfac lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c33e expref: 466 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.325435:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2a00/0x557988ac98fecfc1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c33e expref: 465 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.325442:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b7:0x0].0x0 (ffff91604464e200) 00010000:00010000:1.0:1769074934.325445:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074934.325447:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2a00, rc 0) 00000100:00100000:1.0:1769074934.325590:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+466:67888:x1855007616222208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4619us (4842us total) trans 4294969164 rc 0/0 00000100:00100000:1.0:1769074934.325601:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9823 00000100:00100000:2.0:1769074934.331842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.331957:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222336 00000100:00100000:1.0:1769074934.331971:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222336 00000100:00100000:1.0:1769074934.332056:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2853 00000100:00100000:1.0:1769074934.332069:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2418:x1855007616222336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.332105:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.332132:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c345 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074934.332176:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074934.332204:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.332206:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.332217:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.332239:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 223 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074934.332256:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074934.332342:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2418:x1855007616222336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 275us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.332351:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2853 00000100:00100000:3.0:1769074934.339676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.339917:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222464 00000100:00100000:2.0:1769074934.339931:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222464 00000100:00100000:2.0:1769074934.340022:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2854 00000100:00100000:2.0:1769074934.340035:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:67888:x1855007616222464:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.340061:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.340086:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c34c expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.340132:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.340142:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.340144:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.340149:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c34c expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.340209:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 224 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.340225:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 224 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074934.340242:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626644992:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074934.340379:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916143928b40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074934.347871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.348425:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222592 00000100:00100000:0.0:1769074934.348439:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222592 00010000:00010000:0.0:1769074934.348585:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:0.0:1769074934.348633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1953 00000100:00100000:0.0:1769074934.348644:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616222592:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074934.348663:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074934.348690:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.348707:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.348747:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.348750:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.348759:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c34c expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.348770:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c34c expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.348821:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c34c expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074934.348839:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626645120:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074934.348985:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6900 going to sleep for 11 seconds 00010000:00010000:2.0:1769074934.351114:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3000/0x557988ac98fecfcf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c345 expref: 225 pid: 8406 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074934.351153:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626644992:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074934.351191:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e200/0x557988ac98fecfd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c34c expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.351209:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e200, rc 0) 00000100:00100000:2.0:1769074934.351291:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67888:x1855007616222464:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11259us (11630us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.351302:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2854 00000100:00100000:1.0:1769074934.355884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.356045:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222848 00000100:00100000:2.0:1769074934.356060:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222848 00000100:00100000:2.0:1769074934.356145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1938 00000100:00100000:2.0:1769074934.356158:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+466:67888:x1855007616222848:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074934.356580:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67888:x1855007616222848:12345-192.168.204.32@tcp:35:cp.0 Request processed in 422us (709us total) trans 4294969165 rc 0/0 00000100:00100000:2.0:1769074934.356590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1938 00000100:00100000:0.0:1769074934.357180:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626645120:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074934.357212:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074934.357263:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2420:x1855007616222592:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8617us (9403us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.357274:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1953 00000100:00100000:2.0:1769074934.437569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.437772:0:7534:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616222976 00000100:00100000:1.0:1769074934.437792:0:7534:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616222976 00000100:00100000:1.0:1769074934.437885:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9824 00000100:00100000:1.0:1769074934.437899:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67892:x1855007616222976:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074934.437928:0:7534:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.437956:0:7534:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecfdd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c353 expref: -99 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.438060:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.438079:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438096:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438115:0:7534:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7534 initiator: MDT0 00010000:00010000:1.0:1769074934.438122:0:7534:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438128:0:7534:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438196:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438205:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438212:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438219:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.438224:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438233:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438249:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.438252:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.438259:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438265:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fecfe4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438285:0:7534:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438291:0:7534:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438296:0:7534:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438301:0:7534:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.438319:0:7534:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438325:0:7534:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438333:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff91604464ee00) 00010000:00010000:1.0:1769074934.438335:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.438338:0:7534:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438344:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fecfeb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:1.0:1769074934.438384:0:7534:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecfdd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c353 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.438395:0:7534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.438398:0:7534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.438401:0:7534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fecfdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c353 expref: 7 pid: 7534 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.438415:0:7534:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3400, rc 0) 00000100:00100000:1.0:1769074934.438511:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67892:x1855007616222976:12345-192.168.204.32@tcp:101:bash.0 Request processed in 614us (978us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074934.438519:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9824 00000100:00100000:3.0:1769074934.453517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.454476:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223232 00000100:00100000:2.0:1769074934.454489:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223232 00000100:00100000:2.0:1769074934.454585:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 290 00000100:00100000:2.0:1769074934.454595:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:2418:x1855007616223232:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.454648:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.454670:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fecff2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c35a expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.454731:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.454747:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454770:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454787:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.454799:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454805:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454854:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454862:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454868:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454875:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.454879:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.454886:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455069:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.455073:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.455079:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455085:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fecff9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455099:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455105:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455111:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455116:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.455119:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455124:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455131:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x41eab4ef (ffff91604e58c800) 00010000:00010000:2.0:1769074934.455133:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.455136:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455142:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed000 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.455251:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fecff2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c35a expref: 468 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.455261:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.455264:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.455267:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fecff2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c35a expref: 468 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.455276:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc -2) 00000100:00100000:2.0:1769074934.455351:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:2418:x1855007616223232:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 757us (1844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.455360:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 290 00000100:00100000:3.0:1769074934.458719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.459136:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223104 00000100:00100000:0.0:1769074934.459157:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223104 00000100:00100000:0.0:1769074934.459252:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9825 00000100:00100000:0.0:1769074934.459265:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67893:x1855007616223104:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.459295:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.459325:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed007 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c361 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.459427:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.459447:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.459461:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.459478:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.459485:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.459492:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461030:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461048:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461055:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461061:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.461066:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461074:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461099:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.461103:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.461109:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461116:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed00e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461136:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461142:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461147:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461152:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.461154:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461160:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461167:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff916052ae5600) 00010000:00010000:0.0:1769074934.461169:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.461172:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461176:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed015 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.461231:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed007 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c361 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.461243:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.461245:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.461249:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed007 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c361 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.461259:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074934.461373:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67893:x1855007616223104:12345-192.168.204.32@tcp:101:rm.0 Request processed in 2109us (2662us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.461384:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9825 00000100:00100000:3.0:1769074934.466985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.467216:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223360 00000100:00100000:0.0:1769074934.467236:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223360 00000100:00100000:0.0:1769074934.467328:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9826 00000100:00100000:0.0:1769074934.467340:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67893:x1855007616223360:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.467365:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.467393:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed01c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c368 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.467483:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.467502:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.467516:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.467576:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.467589:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.467596:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468135:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468145:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468153:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468159:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.468164:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468173:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468188:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.468192:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.468198:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468204:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed023 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468220:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468225:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468231:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468235:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.468238:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468244:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468251:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff916052ae5600) 00010000:00010000:0.0:1769074934.468254:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.468256:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468262:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed02a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.468300:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed01c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c368 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.468310:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.468313:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.468317:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed01c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c368 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.468325:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074934.468420:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67893:x1855007616223360:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1080us (1445us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.468428:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9826 00000100:00100000:3.0:1769074934.481714:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.481785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.481826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.481852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.481878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.482033:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223744 00000100:00100000:0.0:1769074934.482034:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223488 00000100:00100000:1.0:1769074934.482056:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223744 00000100:00100000:0.0:1769074934.482057:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223488 00000100:00100000:0.0:1769074934.482165:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 277 00000100:00100000:0.0:1769074934.482176:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2417:x1855007616223488:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074934.482182:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223872 00000100:00100000:1.0:1769074934.482189:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223872 00000100:00100000:1.0:1769074934.482238:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2104 00000100:00100000:1.0:1769074934.482250:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616223744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074934.482262:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2417:x1855007616223488:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 85us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.482272:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 277 00000100:00100000:0.0:1769074934.482323:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224000 00000100:00100000:1.0:1769074934.482324:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616223744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.482331:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224000 00000100:00100000:1.0:1769074934.482338:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2104 00000100:00100000:1.0:1769074934.482370:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2105 00000100:00100000:1.0:1769074934.482379:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2417:x1855007616223872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074934.482391:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616223616 00000100:00100000:0.0:1769074934.482397:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616223616 00000100:00100000:1.0:1769074934.482416:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2417:x1855007616223872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.482426:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2105 00000100:00100000:0.0:1769074934.482438:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3158 00000100:00100000:0.0:1769074934.482449:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616224000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074934.482469:0:7534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3159 00000100:00100000:1.0:1769074934.482481:0:7534:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2417:x1855007616223616:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074934.482515:0:7534:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2417:x1855007616223616:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 38us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.482521:0:7534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3159 00000100:00100000:0.0:1769074934.482754:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616224000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 303us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.482762:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3158 00000100:00080000:2.0:1769074934.482986:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074934.494524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.494694:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224128 00000100:00100000:2.0:1769074934.494713:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224128 00000100:00100000:2.0:1769074934.494787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9827 00000100:00100000:2.0:1769074934.494796:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67894:x1855007616224128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.494815:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.494837:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed031 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c36f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.494919:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.494941:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.494952:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.494968:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.494973:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.494979:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495136:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495143:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495149:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495156:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495162:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.495165:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495172:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495185:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.495188:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.495192:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed038 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495212:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495219:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495224:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495229:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.495231:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495237:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495248:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff91604e58c800) 00010000:00010000:2.0:1769074934.495250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.495253:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495259:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed03f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.495296:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed031 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c36f expref: 468 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.495307:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.495310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.495313:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed031 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c36f expref: 468 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.495323:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074934.495396:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67894:x1855007616224128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 600us (888us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.495403:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9827 00000100:00100000:3.0:1769074934.500060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.510586:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224256 00000100:00100000:0.0:1769074934.510614:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224256 00000100:00100000:2.0:1769074934.513328:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9828 00000100:00100000:2.0:1769074934.513364:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67894:x1855007616224256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.513389:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.513412:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed046 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c376 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.513500:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.513522:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513552:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513569:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.513576:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513582:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513637:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513645:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513652:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513658:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.513663:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513671:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513683:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.513686:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.513691:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513697:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed04d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513711:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513717:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513722:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513727:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.513730:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513735:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513742:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff91604e58c800) 00010000:00010000:2.0:1769074934.513744:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.513747:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513752:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed054 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.513783:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed046 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c376 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.513794:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.513797:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.513801:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed046 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c376 expref: 468 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.513810:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074934.513897:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67894:x1855007616224256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 556us (13851us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.513905:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9828 00000100:00100000:3.0:1769074934.529363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.530692:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224512 00000100:00100000:2.0:1769074934.530711:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224512 00000100:00100000:2.0:1769074934.530799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9829 00000100:00100000:2.0:1769074934.530810:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+467:67894:x1855007616224512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.530833:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.530856:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed05b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c37d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.531205:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.531222:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.531233:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.531247:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.531254:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.531260:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074934.533377:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd7:0x0], index 0: 0 00010000:00010000:2.0:1769074934.534444:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ea00/0x557988ac98fed070 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.534462:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ea00/0x557988ac98fed070 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.535923:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ea00/0x557988ac98fed070 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.535991:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536008:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536015:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536022:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536027:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.536031:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536038:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536050:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.536053:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.536057:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536067:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed062 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074934.536084:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000364035b8 reply state 00000000dec3b26f transno 4294969166 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536096:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.536102:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff91604e58c800) 00010000:00010000:2.0:1769074934.536105:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074934.536108:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074934.536145:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed05b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c37d expref: 470 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.536158:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ea00/0x557988ac98fed070 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c37d expref: 469 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.536166:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b8:0x0].0x0 (ffff91604e58c200) 00010000:00010000:2.0:1769074934.536169:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074934.536172:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ea00, rc 0) 00000100:00100000:2.0:1769074934.536246:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+470:67894:x1855007616224512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5437us (6899us total) trans 4294969166 rc 0/0 00000100:00100000:2.0:1769074934.536254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9829 00000100:00100000:3.0:1769074934.540863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.540983:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224640 00000100:00100000:0.0:1769074934.541008:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224640 00000100:00100000:0.0:1769074934.541081:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2855 00000100:00100000:0.0:1769074934.541091:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616224640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.541109:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.541131:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c384 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074934.541157:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074934.541178:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.541180:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.541188:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 225 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.541204:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 225 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.541228:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074934.541298:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616224640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 209us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.541305:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2855 00000100:00100000:3.0:1769074934.545483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.545571:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224768 00000100:00100000:2.0:1769074934.545582:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224768 00000100:00100000:2.0:1769074934.545633:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2856 00000100:00100000:2.0:1769074934.545641:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:67894:x1855007616224768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.545658:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.545675:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c38b expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.545703:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.545713:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.545715:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.545719:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c38b expref: 226 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.545760:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.545774:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 2023 lvb_type: 1 00000100:00100000:2.0:1769074934.545788:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626645248:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074934.545887:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150004a80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074934.549351:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626645248:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074934.549383:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c38b expref: 226 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.549402:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e600, rc 0) 00000100:00100000:2.0:1769074934.549461:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:67894:x1855007616224768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3820us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.549479:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2856 00000100:00100000:2.0:1769074934.551967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.552084:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616224896 00000100:00100000:0.0:1769074934.552095:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616224896 00010000:00010000:0.0:1769074934.552150:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 2023 lvb_type: 1 00000100:00100000:0.0:1769074934.552201:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1954 00000100:00100000:0.0:1769074934.552212:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616224896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074934.552226:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074934.552246:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.552260:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.552282:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed07e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c384 expref: 226 pid: 24564 timeout: 2023 lvb_type: 1 00010000:00010000:0.0:1769074934.552299:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.552301:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.552308:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c38b expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.552317:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c38b expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.552353:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e600/0x557988ac98fed085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c38b expref: 225 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074934.552366:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626645376:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074934.552453:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6480 going to sleep for 11 seconds 00000100:00100000:3.0:1769074934.559148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.559363:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626645376:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074934.559393:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074934.559466:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616224896:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7255us (7508us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.559477:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1954 00000100:00100000:1.0:1769074934.559827:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225152 00000100:00100000:1.0:1769074934.559836:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225152 00000100:00100000:1.0:1769074934.559887:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1939 00000100:00100000:1.0:1769074934.559907:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+470:67894:x1855007616225152:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074934.560196:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67894:x1855007616225152:12345-192.168.204.32@tcp:35:cp.0 Request processed in 300us (1058us total) trans 4294969167 rc 0/0 00000100:00100000:1.0:1769074934.560204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1939 00000100:00100000:3.0:1769074934.592179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.592728:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225280 00000100:00100000:2.0:1769074934.592740:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225280 00000100:00100000:2.0:1769074934.592813:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 291 00000100:00100000:2.0:1769074934.592824:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616225280:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.592862:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.592883:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed08c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c392 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.592943:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.592958:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.592968:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.592983:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.592988:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593005:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593055:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593063:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593069:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593075:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.593079:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593085:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593096:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.593099:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.593103:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593109:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed093 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593133:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593140:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593145:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593150:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.593153:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593159:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593166:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x41eab4ef (ffff9161748d2400) 00010000:00010000:2.0:1769074934.593168:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.593171:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593176:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed09a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x41eab4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.593204:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed08c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c392 expref: 472 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.593213:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.593215:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.593219:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed08c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c392 expref: 472 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.593226:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc -2) 00000100:00100000:2.0:1769074934.593298:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616225280:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 476us (1129us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.593306:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 291 00000100:00100000:3.0:1769074934.611849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.616165:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225408 00000100:00100000:2.0:1769074934.616183:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225408 00000100:00100000:2.0:1769074934.616266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9830 00000100:00100000:2.0:1769074934.616277:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67897:x1855007616225408:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074934.616296:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.616318:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c399 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.616383:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.616398:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616410:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616425:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.616432:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616438:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616498:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616507:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616513:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616519:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616525:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.616565:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616575:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616587:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.616591:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.616596:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616602:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616615:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616620:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616625:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616630:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.616632:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616637:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616644:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff9161748d2400) 00010000:00010000:2.0:1769074934.616646:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.616648:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616653:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.616679:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c399 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.616688:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.616691:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.616695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c399 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.616703:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:2.0:1769074934.616779:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67897:x1855007616225408:12345-192.168.204.32@tcp:101:bash.0 Request processed in 504us (4939us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.616786:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9830 00000100:00100000:3.0:1769074934.638419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.638691:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225536 00000100:00100000:2.0:1769074934.638701:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225536 00000100:00100000:2.0:1769074934.638758:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9831 00000100:00100000:2.0:1769074934.638766:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67898:x1855007616225536:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074934.638786:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.638805:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c3a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.638864:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.638877:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638886:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638910:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.638917:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638923:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638973:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638979:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.638985:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639000:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639006:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.639011:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639017:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639028:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.639032:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.639036:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639042:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed0bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639056:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639061:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639067:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639072:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.639074:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639080:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639086:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff9161748d2400) 00010000:00010000:2.0:1769074934.639088:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.639091:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639097:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.639132:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0b6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3a0 expref: 472 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.639141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.639144:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.639147:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3a0 expref: 472 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.639155:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:2.0:1769074934.639220:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67898:x1855007616225536:12345-192.168.204.32@tcp:101:rm.0 Request processed in 453us (810us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.639227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9831 00000100:00100000:3.0:1769074934.640269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.640421:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225664 00000100:00100000:1.0:1769074934.640429:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225664 00000100:00100000:1.0:1769074934.640476:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 292 00000100:00100000:1.0:1769074934.640485:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616225664:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074934.640590:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.640622:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed0cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c3a7 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.640670:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.640682:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640691:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640706:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.640712:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640718:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640761:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640768:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640773:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640777:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.640782:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640787:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640797:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.640800:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.640804:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640810:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed0d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640821:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640827:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640831:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640836:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.640839:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640844:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640849:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074934.640852:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.640854:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640858:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed0d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.640881:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed0cb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3a7 expref: 472 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.640890:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.640892:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074934.640896:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed0cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3a7 expref: 472 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.640903:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3800, rc -2) 00000100:00100000:1.0:1769074934.640952:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616225664:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 468us (687us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074934.640959:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 292 00000100:00100000:3.0:1769074934.648640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.648899:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225792 00000100:00100000:0.0:1769074934.648910:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225792 00000100:00100000:0.0:1769074934.648977:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9832 00000100:00100000:0.0:1769074934.648987:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67898:x1855007616225792:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.649019:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.649041:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed0e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c3df expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.649114:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.649129:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649142:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649166:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.649173:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649179:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649234:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649240:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649247:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649251:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.649256:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649263:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649277:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.649280:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.649286:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649292:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed0e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649304:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649309:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649315:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649320:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.649323:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649328:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649334:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff916052ae5100) 00010000:00010000:0.0:1769074934.649336:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.649339:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649343:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed0ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.649371:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed0e0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3df expref: 472 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.649381:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.649383:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.649386:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed0e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3df expref: 472 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.649393:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074934.649455:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67898:x1855007616225792:12345-192.168.204.32@tcp:101:rm.0 Request processed in 469us (826us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.649463:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9832 00000100:00100000:0.0:1769074934.671233:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.671329:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616225920 00000100:00100000:2.0:1769074934.671340:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616225920 00000100:00100000:2.0:1769074934.671400:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9833 00000100:00100000:2.0:1769074934.671409:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67901:x1855007616225920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.671429:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.671450:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c3e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.671568:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.671583:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671595:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671619:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.671626:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671632:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671684:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671691:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671697:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671705:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671711:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.671716:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671724:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671736:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.671739:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.671743:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671750:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed0fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671764:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671771:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671777:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671782:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.671785:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671790:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff9161748d2400) 00010000:00010000:2.0:1769074934.671800:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.671804:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671810:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed103 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.671848:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0f5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3e6 expref: 472 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.671858:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.671860:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.671864:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed0f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3e6 expref: 472 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.671873:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:2.0:1769074934.671928:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67901:x1855007616225920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 520us (704us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.671936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9833 00000100:00100000:3.0:1769074934.676013:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.678950:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226048 00000100:00100000:2.0:1769074934.678967:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226048 00000100:00100000:2.0:1769074934.679049:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 293 00000100:00100000:2.0:1769074934.679059:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616226048:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.679116:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.679136:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed10a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c3ed expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.679203:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.679219:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679231:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679244:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.679251:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679257:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679306:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679313:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679319:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679325:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.679329:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679337:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679349:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.679352:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.679357:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679362:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed111 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679375:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679380:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679385:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679389:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.679392:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679397:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679403:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff9161748d2400) 00010000:00010000:2.0:1769074934.679406:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.679408:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679413:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed118 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.679439:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed10a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3ed expref: 472 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.679449:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.679451:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.679454:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed10a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c3ed expref: 472 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.679469:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc -2) 00000100:00100000:2.0:1769074934.679725:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:2418:x1855007616226048:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 665us (3719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.679734:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 293 00000100:00100000:3.0:1769074934.682752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.682836:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226176 00000100:00100000:0.0:1769074934.682845:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226176 00000100:00100000:0.0:1769074934.682907:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9834 00000100:00100000:0.0:1769074934.682916:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67901:x1855007616226176:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.682936:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.682956:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed11f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c425 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.683031:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.683046:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683056:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683071:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074934.683078:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683084:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683140:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683147:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683165:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683171:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.683174:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683180:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683192:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.683196:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.683200:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683206:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed126 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683219:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683224:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683230:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683234:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.683236:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683241:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683248:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff916052ae5100) 00010000:00010000:0.0:1769074934.683250:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.683253:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683258:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed12d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074934.683290:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed11f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c425 expref: 472 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.683299:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.683301:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.683305:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efc00/0x557988ac98fed11f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c425 expref: 472 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.683313:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efc00, rc 0) 00000100:00100000:0.0:1769074934.683375:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67901:x1855007616226176:12345-192.168.204.32@tcp:101:cp.0 Request processed in 460us (631us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.683382:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9834 00000100:00100000:0.0:1769074934.691550:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.691686:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226432 00000100:00100000:2.0:1769074934.691696:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226432 00000100:00100000:2.0:1769074934.691754:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9835 00000100:00100000:2.0:1769074934.691763:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+471:67901:x1855007616226432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.691783:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.691803:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed134 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c42c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.691923:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.691938:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.691949:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.691962:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.691970:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.691977:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074934.692467:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd8:0x0], index 1: 0 00010000:00010000:2.0:1769074934.692654:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fed149 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.692665:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fed149 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692673:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fed149 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692706:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692712:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692718:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692724:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692730:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.692734:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692741:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.692756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.692761:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692770:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed13b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074934.692783:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c57ddeaa reply state 000000009daef781 transno 4294969168 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692793:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.692798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff9161748d2400) 00010000:00010000:2.0:1769074934.692800:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074934.692803:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074934.692834:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed134 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c42c expref: 474 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.692847:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fa00/0x557988ac98fed149 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c42c expref: 473 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.692855:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b9:0x0].0x0 (ffff9161748d2c00) 00010000:00010000:2.0:1769074934.692858:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074934.692860:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fa00, rc 0) 00000100:00100000:2.0:1769074934.693078:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+474:67901:x1855007616226432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1313us (1552us total) trans 4294969168 rc 0/0 00000100:00100000:2.0:1769074934.693088:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9835 00000100:00100000:3.0:1769074934.704102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.704260:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226560 00000100:00100000:2.0:1769074934.704273:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226560 00000100:00100000:2.0:1769074934.704333:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2857 00000100:00100000:2.0:1769074934.704343:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616226560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.704362:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.704404:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c433 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074934.704426:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074934.704446:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.704448:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.704456:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 224 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.704474:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 224 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.704487:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:2.0:1769074934.704586:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616226560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 242us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.704596:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2857 00000100:00100000:1.0:1769074934.708010:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1769074934.708032:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626645504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074934.708099:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074934.708307:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626645504 00000100:00100000:3.0:1769074934.708316:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626645504 00000100:00100000:3.0:1769074934.708379:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1769074934.708390:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1855007626645504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769074934.708416:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2924544 granted 493316160 pending 430080 free 3764371456 avail 3532849152 00000100:00100000:3.0:1769074934.708460:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1855007626645504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074934.708467:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00080000:1.0:1769074934.708814:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074934.708851:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626645504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1769074934.711048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.711375:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226688 00000100:00100000:0.0:1769074934.711386:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226688 00000100:00100000:0.0:1769074934.711442:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2858 00000100:00100000:0.0:1769074934.711476:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67901:x1855007616226688:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.711502:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.711521:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c43a expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.711584:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 225 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.711592:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.711594:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.711607:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c43a expref: 225 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.711640:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 225 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.711652:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 225 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:0.0:1769074934.711666:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626645632:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074934.711750:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6480 going to sleep for 11 seconds 00000100:00100000:0.0:1769074934.716378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.716469:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616226816 00000100:00100000:2.0:1769074934.716480:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616226816 00010000:00010000:2.0:1769074934.716568:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 226 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074934.716612:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1955 00000100:00100000:2.0:1769074934.716621:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616226816:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074934.716635:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074934.716656:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 226 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:2.0:1769074934.716674:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 226 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:2.0:1769074934.716698:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.716701:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.716709:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c43a expref: 226 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.716720:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c43a expref: 226 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.716757:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c43a expref: 226 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074934.716771:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626645760:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074934.716860:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315300 going to sleep for 11 seconds 00010000:00010000:3.0:1769074934.717778:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed157 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c433 expref: 226 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:3.0:1769074934.717796:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626645632:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074934.717821:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f1efc00/0x557988ac98fed15e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c43a expref: 225 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.717833:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efc00, rc 0) 00000100:00100000:3.0:1769074934.717882:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:67901:x1855007616226688:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6408us (6842us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074934.717899:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2858 00000100:00100000:1.0:1769074934.722889:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626645760:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074934.722923:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074934.722981:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616226816:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6360us (6610us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.723006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1955 00000100:00100000:1.0:1769074934.724957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.725184:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227072 00000100:00100000:2.0:1769074934.725194:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227072 00000100:00100000:2.0:1769074934.725253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1940 00000100:00100000:2.0:1769074934.725262:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+474:67901:x1855007616227072:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074934.725620:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67901:x1855007616227072:12345-192.168.204.32@tcp:35:cp.0 Request processed in 358us (670us total) trans 4294969169 rc 0/0 00000100:00100000:2.0:1769074934.725628:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1940 00000100:00100000:3.0:1769074934.760595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.760900:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227200 00000100:00100000:1.0:1769074934.760911:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227200 00000100:00100000:1.0:1769074934.760973:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 294 00000100:00100000:1.0:1769074934.760982:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:2417:x1855007616227200:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074934.761055:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.761076:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed165 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c441 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.761140:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.761166:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761177:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761191:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074934.761198:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761204:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761252:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761259:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761266:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761272:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.761277:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761284:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761296:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.761299:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.761303:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761309:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed16c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761322:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761327:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761332:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761336:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.761340:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761345:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761351:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074934.761354:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.761356:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761361:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed173 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074934.761386:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed165 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c441 expref: 476 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.761397:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.761399:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074934.761403:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed165 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c441 expref: 476 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.761412:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc -2) 00000100:00100000:1.0:1769074934.761478:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:2417:x1855007616227200:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 497us (894us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074934.761485:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 294 00000100:00100000:0.0:1769074934.784874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.785081:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227328 00000100:00100000:2.0:1769074934.785095:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227328 00000100:00100000:2.0:1769074934.785164:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9836 00000100:00100000:2.0:1769074934.785174:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67908:x1855007616227328:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074934.785198:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.785221:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed17a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c479 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.785286:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.785299:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785310:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785324:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.785330:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785336:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785389:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785397:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785403:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785408:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.785412:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785418:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785431:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.785434:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.785439:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785444:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed181 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785457:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785462:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785467:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785472:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.785475:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785481:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785487:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604f3c7f00) 00010000:00010000:2.0:1769074934.785490:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.785492:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785501:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed188 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.785586:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed17a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c479 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.785596:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.785598:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.785602:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed17a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c479 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.785611:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fc00, rc 0) 00000100:00100000:2.0:1769074934.785675:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67908:x1855007616227328:12345-192.168.204.32@tcp:101:bash.0 Request processed in 503us (813us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.785683:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9836 00000100:00100000:3.0:1769074934.802686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.802878:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227456 00000100:00100000:0.0:1769074934.802895:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227456 00000100:00100000:0.0:1769074934.802951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9837 00000100:00100000:0.0:1769074934.802960:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67909:x1855007616227456:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.802980:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.803028:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed18f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c480 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.803109:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.803123:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803134:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803317:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.803327:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803334:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803392:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803399:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803405:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803416:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803422:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.803426:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803432:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803443:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.803446:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.803450:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803456:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed196 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803468:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803474:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803480:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803484:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.803486:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803491:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803502:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff916052ae5100) 00010000:00010000:0.0:1769074934.803504:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.803506:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803512:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed19d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.803586:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed18f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c480 expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.803595:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.803597:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.803609:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed18f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c480 expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.803617:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee200, rc 0) 00000100:00100000:0.0:1769074934.803677:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67909:x1855007616227456:12345-192.168.204.32@tcp:101:rm.0 Request processed in 718us (1002us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.803685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9837 00000100:00100000:3.0:1769074934.807947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.808032:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227584 00000100:00100000:0.0:1769074934.808042:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227584 00000100:00100000:0.0:1769074934.808107:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9838 00000100:00100000:0.0:1769074934.808116:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67909:x1855007616227584:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074934.808135:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.808166:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1a4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c487 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.808245:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.808259:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808268:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808282:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.808288:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808293:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808348:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808355:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808361:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808366:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808372:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.808376:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808387:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808399:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.808403:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.808407:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808412:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808425:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808430:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808435:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808440:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.808443:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808448:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808455:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff916052ae5d00) 00010000:00010000:0.0:1769074934.808457:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.808460:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808464:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.808505:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1a4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c487 expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.808516:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.808518:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.808521:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c487 expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.808577:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074934.808640:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67909:x1855007616227584:12345-192.168.204.32@tcp:101:rm.0 Request processed in 525us (703us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.808647:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9838 00000100:00100000:3.0:1769074934.824666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.824789:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227712 00000100:00100000:2.0:1769074934.824800:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227712 00000100:00100000:2.0:1769074934.824865:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 295 00000100:00100000:2.0:1769074934.824874:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:2420:x1855007616227712:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.824920:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.824943:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed1b9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c48e expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.825015:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.825030:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825044:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825058:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.825064:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825069:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825120:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825126:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825132:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825138:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.825142:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825381:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825396:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.825399:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.825404:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825410:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed1c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825425:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825431:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825438:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825444:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.825447:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825453:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825459:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x50cbaa19 (ffff91604f3c7f00) 00010000:00010000:2.0:1769074934.825462:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.825465:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825470:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed1c7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.825497:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed1b9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c48e expref: 476 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.825506:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.825508:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.825512:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed1b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c48e expref: 476 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.825527:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fc00, rc -2) 00000100:00100000:2.0:1769074934.825742:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:2420:x1855007616227712:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 868us (1084us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.825751:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 295 00000100:00100000:3.0:1769074934.832753:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.833038:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227840 00000100:00100000:2.0:1769074934.833050:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227840 00000100:00100000:2.0:1769074934.833113:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9839 00000100:00100000:2.0:1769074934.833123:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67910:x1855007616227840:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.833145:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.833180:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f800/0x557988ac98fed1ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c495 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.833282:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.833300:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833311:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833329:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.833339:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833348:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833408:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833416:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833423:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833429:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.833434:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833443:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833455:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.833459:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.833464:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833471:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed1d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833489:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833495:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833500:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833505:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.833509:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833515:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833522:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604f3c7000) 00010000:00010000:2.0:1769074934.833525:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.833528:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833566:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.833602:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f800/0x557988ac98fed1ce lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c495 expref: 476 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.833611:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.833613:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.833617:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f800/0x557988ac98fed1ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c495 expref: 476 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.833626:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f800, rc 0) 00000100:00100000:2.0:1769074934.833687:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67910:x1855007616227840:12345-192.168.204.32@tcp:101:cp.0 Request processed in 565us (943us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.833695:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9839 00000040:00080000:1.0:1769074934.836777:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1769074934.836787:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1769074934.837323:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1769074934.837336:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1769074934.842120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.842236:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616227968 00000100:00100000:0.0:1769074934.842247:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616227968 00000100:00100000:0.0:1769074934.842311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9840 00000100:00100000:0.0:1769074934.842321:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67910:x1855007616227968:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.842341:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.842363:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c49c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.842432:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.842447:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842456:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842474:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074934.842480:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842486:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842608:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842616:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842622:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842629:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842634:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.842639:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842647:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842658:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.842661:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.842666:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842671:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed1ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842688:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842693:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842698:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842702:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074934.842706:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842711:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842718:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff916052ae5d00) 00010000:00010000:0.0:1769074934.842721:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.842723:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842728:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed1f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074934.842760:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1e3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c49c expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.842770:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074934.842773:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074934.842776:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed1e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c49c expref: 476 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.842789:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074934.842853:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67910:x1855007616227968:12345-192.168.204.32@tcp:101:cp.0 Request processed in 533us (744us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074934.842861:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9840 00000100:00100000:3.0:1769074934.848947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.849141:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228224 00000100:00100000:2.0:1769074934.849160:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228224 00000100:00100000:2.0:1769074934.849222:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9841 00000100:00100000:2.0:1769074934.849232:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+475:67910:x1855007616228224:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.849258:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.849278:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f800/0x557988ac98fed1f8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4a3 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.849393:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.849408:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.849419:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.849433:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.849440:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.849446:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074934.850092:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd8:0x0], index 0: 0 00010000:00010000:2.0:1769074934.850240:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed20d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.850252:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed20d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850261:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed20d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850314:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850323:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850330:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850337:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.850341:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850349:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850360:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.850364:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.850369:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850375:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed1ff lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074934.850390:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a78f62d2 reply state 00000000866a5df8 transno 4294969170 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850401:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.850407:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604f3c7000) 00010000:00010000:2.0:1769074934.850410:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074934.850412:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074934.850443:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f800/0x557988ac98fed1f8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4a3 expref: 478 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.850462:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fc00/0x557988ac98fed20d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ba:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4a3 expref: 477 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.850469:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ba:0x0].0x0 (ffff91604f3c7f00) 00010000:00010000:2.0:1769074934.850472:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074934.850475:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fc00, rc 0) 00000100:00100000:2.0:1769074934.851096:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+478:67910:x1855007616228224:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1861us (2153us total) trans 4294969170 rc 0/0 00000100:00100000:2.0:1769074934.851106:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9841 00000100:00100000:3.0:1769074934.861627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074934.861721:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228352 00000100:00100000:0.0:1769074934.861732:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228352 00000100:00100000:0.0:1769074934.861795:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2859 00000100:00100000:0.0:1769074934.861806:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616228352:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074934.861823:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074934.861843:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4aa expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074934.861866:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074934.861883:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.861885:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074934.861902:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 226 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.861920:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 226 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074934.861932:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074934.861985:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2418:x1855007616228352:12345-192.168.204.32@tcp:101:cp.0 Request processed in 182us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.862000:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2859 00000100:00100000:3.0:1769074934.866138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.866855:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228480 00000100:00100000:2.0:1769074934.866867:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228480 00000100:00100000:2.0:1769074934.867067:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2860 00000100:00100000:2.0:1769074934.867078:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:67910:x1855007616228480:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.867097:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.867115:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4b1 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.867410:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.867421:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.867423:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.867428:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b1 expref: 227 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.867497:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.867511:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074934.867525:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626645888:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074934.867707:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315d80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074934.870615:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626645888:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074934.870655:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b1 expref: 227 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.870677:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f800, rc 0) 00000100:00100000:2.0:1769074934.870736:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:67910:x1855007616228480:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3660us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.870746:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2860 00000100:00100000:3.0:1769074934.873507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.873716:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228608 00000100:00100000:1.0:1769074934.873726:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228608 00010000:00010000:1.0:1769074934.873782:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:1.0:1769074934.873822:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1956 00000100:00100000:1.0:1769074934.873832:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2420:x1855007616228608:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074934.873847:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074934.873870:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074934.873884:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074934.873918:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed21b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4aa expref: 227 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074934.873934:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.873936:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.873944:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b1 expref: 226 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.873953:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b1 expref: 226 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.874003:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f800/0x557988ac98fed222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b1 expref: 226 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074934.874017:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626646016:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074934.875443:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f000 going to sleep for 11 seconds 00000100:00100000:1.0:1769074934.880287:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626646016:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074934.880315:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074934.880373:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616228608:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6541us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074934.880383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1956 00000100:00100000:0.0:1769074934.882902:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.883053:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228864 00000100:00100000:1.0:1769074934.883062:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228864 00000100:00100000:1.0:1769074934.883127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1941 00000100:00100000:1.0:1769074934.883137:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+478:67910:x1855007616228864:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074934.883465:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67910:x1855007616228864:12345-192.168.204.32@tcp:35:cp.0 Request processed in 328us (581us total) trans 4294969171 rc 0/0 00000100:00100000:1.0:1769074934.883473:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1941 00000100:00100000:3.0:1769074934.930058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.930177:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616228992 00000100:00100000:2.0:1769074934.930189:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616228992 00000100:00100000:2.0:1769074934.930252:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9842 00000100:00100000:2.0:1769074934.930261:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67913:x1855007616228992:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074934.930281:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.930303:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed229 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4b8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.930368:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.930382:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930393:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930405:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074934.930411:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930417:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930470:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930477:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930483:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930489:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.930494:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930504:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930517:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.930519:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.930523:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930568:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed230 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930584:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930590:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930596:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930600:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.930604:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930609:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930617:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604f3c7300) 00010000:00010000:2.0:1769074934.930620:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.930623:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930628:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed237 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074934.930662:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed229 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b8 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.930672:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.930674:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.930678:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed229 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4b8 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.930692:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:2.0:1769074934.930755:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67913:x1855007616228992:12345-192.168.204.32@tcp:101:bash.0 Request processed in 495us (707us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074934.930763:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9842 00000100:00100000:0.0:1769074934.943851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.943945:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229120 00000100:00100000:2.0:1769074934.943955:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229120 00000100:00100000:2.0:1769074934.944025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9843 00000100:00100000:2.0:1769074934.944034:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67914:x1855007616229120:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074934.944059:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.944081:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed23e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.944276:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.944292:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944303:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944316:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074934.944324:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944330:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944386:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944394:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944400:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944406:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944412:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.944416:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944423:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944435:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.944438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.944443:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944449:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f200/0x557988ac98fed245 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944462:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944469:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944474:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944481:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.944484:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944490:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604f3c7300) 00010000:00010000:2.0:1769074934.944500:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.944503:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.944509:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed24c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074934.945014:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed23e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4bf expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.945026:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.945028:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.945032:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed23e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4bf expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.945042:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:3.0:1769074934.945190:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67914:x1855007616229120:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1154us (1344us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074934.945199:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9843 00000100:00100000:3.0:1769074934.949475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.949820:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229248 00000100:00100000:2.0:1769074934.949831:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229248 00000100:00100000:2.0:1769074934.949895:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 296 00000100:00100000:2.0:1769074934.949906:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:2419:x1855007616229248:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074934.949942:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.949963:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed253 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4c6 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.950031:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.950044:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950055:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950068:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074934.950074:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950079:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950127:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950134:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950140:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950145:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.950160:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950167:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950179:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.950182:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.950186:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950192:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed25a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950206:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950212:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950217:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950222:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074934.950225:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950230:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950237:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604f3c7500) 00010000:00010000:2.0:1769074934.950239:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074934.950242:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950247:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed261 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074934.950275:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed253 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4c6 expref: 480 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.950285:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074934.950287:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074934.950291:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed253 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4c6 expref: 480 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074934.950300:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc -2) 00000100:00100000:2.0:1769074934.950359:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:2419:x1855007616229248:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 454us (894us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074934.950367:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 296 00000100:00100000:3.0:1769074934.952187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.952750:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229376 00000100:00100000:1.0:1769074934.952759:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229376 00000100:00100000:1.0:1769074934.952808:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9844 00000100:00100000:1.0:1769074934.952817:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67914:x1855007616229376:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074934.952834:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.952853:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed268 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4cd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.952920:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074934.952935:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.952947:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.952962:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074934.952969:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.952974:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953033:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953040:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953046:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953053:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953059:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.953063:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953070:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953082:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.953085:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.953089:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953095:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed26f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953110:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953116:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953121:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953126:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.953129:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953135:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604464ee00) 00010000:00010000:1.0:1769074934.953144:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.953146:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953235:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed276 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074934.953266:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed268 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4cd expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.953277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.953280:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.953284:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed268 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4cd expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.953297:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074934.953360:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67914:x1855007616229376:12345-192.168.204.32@tcp:101:rm.0 Request processed in 544us (1181us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074934.953367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9844 00010000:00010000:1.0:1769074934.966822:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074934.971319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.971785:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229504 00000100:00100000:1.0:1769074934.971797:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229504 00000100:00100000:1.0:1769074934.971867:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9845 00000100:00100000:1.0:1769074934.971879:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67915:x1855007616229504:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074934.971898:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074934.971918:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed27d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4d4 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.971983:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074934.972010:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972021:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972036:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074934.972042:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972047:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972102:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972111:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972118:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972124:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.972128:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972135:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972159:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.972163:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.972168:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972175:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed284 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972187:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972194:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972199:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972205:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074934.972208:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972215:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972222:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604464ee00) 00010000:00010000:1.0:1769074934.972225:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.972228:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972234:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed28b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074934.972264:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed27d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4d4 expref: 480 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.972274:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074934.972276:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074934.972280:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed27d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4d4 expref: 480 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.972289:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074934.972362:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67915:x1855007616229504:12345-192.168.204.32@tcp:101:cp.0 Request processed in 486us (1054us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074934.972370:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9845 00000100:00100000:0.0:1769074934.976072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.976173:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229632 00000100:00100000:3.0:1769074934.976185:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229632 00000100:00100000:3.0:1769074934.976243:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9846 00000100:00100000:3.0:1769074934.976252:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67915:x1855007616229632:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074934.976273:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074934.976295:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed292 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.976363:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074934.976377:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976387:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976402:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074934.976409:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976415:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976469:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976476:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976481:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976773:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976781:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074934.976785:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976792:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976804:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074934.976807:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.976812:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976817:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed299 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976829:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976835:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976841:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976846:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074934.976848:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976854:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976864:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604ec2fc00) 00010000:00010000:3.0:1769074934.976866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.976869:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976873:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed2a0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.976905:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed292 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4db expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.976915:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074934.976917:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.976920:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed292 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4db expref: 480 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.976929:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:3.0:1769074934.976995:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67915:x1855007616229632:12345-192.168.204.32@tcp:101:cp.0 Request processed in 735us (923us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074934.977004:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9846 00000100:00100000:0.0:1769074934.981189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.981255:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616229888 00000100:00100000:3.0:1769074934.981266:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616229888 00000100:00100000:3.0:1769074934.981318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9847 00000100:00100000:3.0:1769074934.981326:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+479:67915:x1855007616229888:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074934.981345:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074934.981365:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed2a7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4e2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.981504:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074934.981518:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.981548:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.981567:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074934.981573:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.981580:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074934.982007:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd9:0x0], index 1: 0 00010000:00010000:3.0:1769074934.982141:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fed2bc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074934.982151:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fed2bc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982158:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fed2bc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982186:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982193:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982203:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982210:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982216:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074934.982220:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982226:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982237:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074934.982239:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074934.982244:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982249:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed2ae lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074934.982260:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b6278022 reply state 00000000a0c252be transno 4294969172 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982269:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074934.982274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604ec2f600) 00010000:00010000:3.0:1769074934.982276:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074934.982278:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074934.982303:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed2a7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e2 expref: 482 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.982320:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ee00/0x557988ac98fed2bc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e2 expref: 481 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.982327:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1bb:0x0].0x0 (ffff91604ec2f700) 00010000:00010000:3.0:1769074934.982329:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074934.982331:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71ee00, rc 0) 00000100:00100000:3.0:1769074934.982398:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+482:67915:x1855007616229888:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1071us (1217us total) trans 4294969172 rc 0/0 00000100:00100000:3.0:1769074934.982406:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9847 00000100:00100000:0.0:1769074934.987648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074934.987803:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230016 00000100:00100000:2.0:1769074934.987815:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230016 00000100:00100000:2.0:1769074934.987873:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2861 00000100:00100000:2.0:1769074934.987883:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2420:x1855007616230016:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074934.987900:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074934.987922:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4e9 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074934.987944:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074934.987964:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.987966:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074934.987975:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 225 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.987999:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 225 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074934.988017:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074934.988074:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616230016:12345-192.168.204.32@tcp:101:cp.0 Request processed in 192us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074934.988081:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2861 00000100:00100000:0.0:1769074934.991595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074934.991669:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230144 00000100:00100000:3.0:1769074934.991679:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230144 00000100:00100000:3.0:1769074934.991730:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2862 00000100:00100000:3.0:1769074934.991738:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:67915:x1855007616230144:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074934.991755:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074934.991772:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4f0 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.991799:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 226 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074934.991808:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074934.991810:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074934.991814:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f0 expref: 226 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074934.991845:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 226 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074934.991859:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 226 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:3.0:1769074934.991873:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049eb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626646144:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074934.991973:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614846a240 going to sleep for 11 seconds 00000100:00100000:3.0:1769074934.994798:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074934.994896:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230272 00000100:00100000:1.0:1769074934.994906:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230272 00010000:00010000:1.0:1769074934.994957:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 227 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:1.0:1769074934.995012:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1957 00000100:00100000:1.0:1769074934.995022:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616230272:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074934.995037:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074934.995057:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 227 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074934.995069:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 227 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074934.995094:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.995097:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074934.995105:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f0 expref: 227 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.995115:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f0 expref: 227 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074934.995163:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f0 expref: 227 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074934.995175:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626646272:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074934.995261:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1769074934.996015:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed2ca lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4e9 expref: 227 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:0.0:1769074934.996031:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626646144:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074934.996056:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604e71e400/0x557988ac98fed2d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f0 expref: 226 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074934.996067:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e71e400, rc 0) 00000100:00100000:0.0:1769074934.996117:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:67915:x1855007616230144:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4379us (4530us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074934.996124:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2862 00000100:00100000:1.0:1769074935.001452:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626646272:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074935.001477:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074935.001620:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616230272:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6597us (6830us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074935.001631:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1957 00000100:00100000:2.0:1769074935.002560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.002827:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230528 00000100:00100000:0.0:1769074935.002837:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230528 00000100:00100000:0.0:1769074935.002901:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1942 00000100:00100000:0.0:1769074935.002911:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+482:67915:x1855007616230528:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074935.003217:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67915:x1855007616230528:12345-192.168.204.32@tcp:35:cp.0 Request processed in 307us (686us total) trans 4294969173 rc 0/0 00000100:00100000:0.0:1769074935.003225:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1942 00000100:00080000:1.0:1769074935.003489:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769074935.052582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.053156:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230656 00000100:00100000:1.0:1769074935.053166:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230656 00000100:00100000:1.0:1769074935.053243:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9848 00000100:00100000:1.0:1769074935.053252:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67919:x1855007616230656:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074935.053271:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.053294:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4f7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.053388:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.053403:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.053414:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.053428:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.053435:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.053442:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000100:00080000:2.0:1769074935.054132:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1769074935.054246:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054259:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054265:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054271:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.054275:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054282:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054295:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.054298:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.054302:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054309:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054324:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054330:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054336:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054341:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.054344:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054354:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054361:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604464ee00) 00010000:00010000:1.0:1769074935.054363:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.054366:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054371:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.054409:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2d8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.054420:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.054422:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.054426:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4f7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.054436:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.054510:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67919:x1855007616230656:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1258us (1938us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.054519:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9848 00000100:00100000:2.0:1769074935.068183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.068278:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230784 00000100:00100000:1.0:1769074935.068289:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230784 00000100:00100000:1.0:1769074935.068343:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9849 00000100:00100000:1.0:1769074935.068353:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67920:x1855007616230784:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.068378:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.068398:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c4fe expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.068461:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.068476:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068488:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068516:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.068523:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068565:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068627:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068635:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068641:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068646:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.068650:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068658:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068671:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.068674:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.068679:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068685:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed2f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068696:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068702:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068708:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068713:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.068716:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068722:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068728:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604464ee00) 00010000:00010000:1.0:1769074935.068730:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.068733:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068739:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed2fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.068768:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4fe expref: 484 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.068778:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.068781:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.068784:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed2ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c4fe expref: 484 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.068793:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.068854:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67920:x1855007616230784:12345-192.168.204.32@tcp:101:rm.0 Request processed in 502us (689us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.068861:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9849 00000100:00100000:3.0:1769074935.071118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.071195:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616230912 00000100:00100000:1.0:1769074935.071204:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616230912 00000100:00100000:1.0:1769074935.071261:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 297 00000100:00100000:1.0:1769074935.071272:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:2418:x1855007616230912:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074935.071328:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.071348:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed302 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c505 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.071402:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.071417:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071427:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071441:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.071451:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071457:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071838:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071846:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071853:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071860:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.071864:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071871:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071882:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.071885:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.071890:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071896:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed309 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071910:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071916:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071922:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071926:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.071929:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071934:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071940:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff91604464ef00) 00010000:00010000:1.0:1769074935.071943:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.071945:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071950:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed310 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.071978:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed302 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c505 expref: 484 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.072002:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.072004:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074935.072008:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed302 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c505 expref: 484 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.072017:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc -2) 00000100:00100000:1.0:1769074935.072128:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:2418:x1855007616230912:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 858us (1019us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074935.072136:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 297 00000100:00100000:2.0:1769074935.078854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.078994:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231040 00000100:00100000:3.0:1769074935.079006:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231040 00000100:00100000:3.0:1769074935.079100:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9850 00000100:00100000:3.0:1769074935.079111:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67920:x1855007616231040:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074935.079133:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.079165:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed317 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c53d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.079237:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.079253:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079265:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079279:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.079285:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079292:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079351:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079358:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079364:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079370:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079376:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.079380:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079387:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079398:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.079402:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.079406:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079412:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed31e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079425:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079431:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079437:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079442:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.079445:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079450:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079456:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.079459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.079461:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079467:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed325 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.079510:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed317 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c53d expref: 484 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.079520:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.079522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.079526:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed317 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c53d expref: 484 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.079558:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604d9b8400, rc 0) 00000100:00100000:3.0:1769074935.079972:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67920:x1855007616231040:12345-192.168.204.32@tcp:101:rm.0 Request processed in 861us (1127us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.079980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9850 00000100:00100000:3.0:1769074935.096760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.096853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.097071:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231296 00000100:00100000:0.0:1769074935.097082:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231296 00000100:00100000:0.0:1769074935.097151:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 298 00000100:00100000:0.0:1769074935.097162:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:2420:x1855007616231296:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074935.097214:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.097234:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed32c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c54b expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.097289:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.097304:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097315:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097328:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.097334:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097340:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097387:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097394:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097400:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097405:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.097410:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097417:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097428:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.097431:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.097435:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097441:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed333 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097454:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097458:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097464:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097468:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.097471:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097476:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097483:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916052ae5b00) 00010000:00010000:0.0:1769074935.097485:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.097488:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097497:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed33a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.097523:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed32c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c54b expref: 484 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.097576:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.097578:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074935.097582:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed32c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c54b expref: 484 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.097591:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efa00, rc -2) 00000100:00100000:0.0:1769074935.097654:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:2420:x1855007616231296:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 494us (800us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074935.097662:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 298 00000100:00100000:1.0:1769074935.098265:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231168 00000100:00100000:1.0:1769074935.098272:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231168 00000100:00100000:1.0:1769074935.098316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9851 00000100:00100000:1.0:1769074935.098324:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67923:x1855007616231168:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.098335:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.098347:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed341 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c544 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.098390:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.098401:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098408:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098421:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.098427:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098433:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098471:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098478:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098483:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098507:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098512:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.098516:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098522:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098555:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.098558:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.098561:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098567:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed348 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098578:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098585:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098600:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098606:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.098609:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098614:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098625:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604464ef00) 00010000:00010000:1.0:1769074935.098627:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.098630:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098634:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed34f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.098658:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed341 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c544 expref: 484 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.098667:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.098668:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.098672:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed341 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c544 expref: 484 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.098680:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc 0) 00000100:00100000:1.0:1769074935.098717:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67923:x1855007616231168:12345-192.168.204.32@tcp:101:cp.0 Request processed in 393us (1967us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.098723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9851 00000100:00100000:0.0:1769074935.103980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.104066:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231424 00000100:00100000:1.0:1769074935.104078:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231424 00000100:00100000:1.0:1769074935.104138:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9852 00000100:00100000:1.0:1769074935.104148:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67923:x1855007616231424:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.104178:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.104200:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed356 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c583 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.104274:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.104290:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104302:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104316:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.104322:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104327:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104375:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104381:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104387:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104391:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.104395:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104402:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104417:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.104420:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.104425:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104431:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed35d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104443:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104450:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104456:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104461:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.104464:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104469:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104476:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604464ee00) 00010000:00010000:1.0:1769074935.104478:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.104481:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104486:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed364 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.104565:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed356 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c583 expref: 484 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.104575:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.104577:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.104582:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed356 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c583 expref: 484 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.104591:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.104664:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67923:x1855007616231424:12345-192.168.204.32@tcp:101:cp.0 Request processed in 517us (692us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.104671:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9852 00000100:00100000:2.0:1769074935.110754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.111155:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231680 00000100:00100000:3.0:1769074935.111168:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231680 00000100:00100000:3.0:1769074935.111232:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9853 00000100:00100000:3.0:1769074935.111242:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+483:67923:x1855007616231680:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.111261:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.111282:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed36b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c58a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.111394:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.111408:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111419:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111434:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.111440:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111446:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1769074935.111768:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd9:0x0], index 0: 0 00010000:00010000:3.0:1769074935.111927:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fed380 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.111937:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fed380 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111945:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fed380 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111977:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.111995:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112002:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112008:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112014:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916174a49800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.112019:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112025:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.112039:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.112043:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49800/0x557988ac98fed372 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1769074935.112061:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d26fff1d reply state 000000008041409d transno 4294969174 ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112071:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.112077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.112079:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1769074935.112082:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1769074935.112110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916174a49a00/0x557988ac98fed36b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c58a expref: 486 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.112122:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423e00/0x557988ac98fed380 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c58a expref: 485 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.112128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1bc:0x0].0x0 (ffff91604ec2f100) 00010000:00010000:3.0:1769074935.112130:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1769074935.112133:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423e00, rc 0) 00000100:00100000:3.0:1769074935.112204:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+486:67923:x1855007616231680:12345-192.168.204.32@tcp:101:cp.0 Request processed in 963us (1459us total) trans 4294969174 rc 0/0 00000100:00100000:3.0:1769074935.112212:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9853 00000001:00080000:2.0:1769074935.116053:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294969174 is committed 00010000:00010000:3.0:1769074935.116218:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116231:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116238:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116244:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116249:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116256:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116276:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5182c6b4 (ffff91604f3c6500) 00010000:00010000:3.0:1769074935.116279:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116283:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116289:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98febba1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5182c6b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116314:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116320:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116326:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116331:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f498400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116334:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116340:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116348:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb29c94cf (ffff91604f4f6d00) 00010000:00010000:3.0:1769074935.116351:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116354:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116359:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f498400/0x557988ac98febc65 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb29c94cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116374:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116380:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116386:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116390:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116392:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116397:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116403:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xcb234504 (ffff916052a4f900) 00010000:00010000:3.0:1769074935.116406:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116408:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116413:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8800/0x557988ac98febd29 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xcb234504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116424:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116430:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116436:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116441:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116444:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116450:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116456:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2cdb5231 (ffff916052a4fe00) 00010000:00010000:3.0:1769074935.116458:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116461:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116467:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8a00/0x557988ac98febdd8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2cdb5231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116478:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116482:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116488:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116508:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116512:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116517:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116523:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3cba48f1 (ffff916052b4c700) 00010000:00010000:3.0:1769074935.116525:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116560:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116566:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98febe9c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3cba48f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116583:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116588:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116892:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116899:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116902:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116908:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116915:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9df8005c (ffff91604f3c6b00) 00010000:00010000:3.0:1769074935.116917:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116920:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116924:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98febf60 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9df8005c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10046 initiator: MDT1 00010000:00010000:3.0:1769074935.116938:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116944:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116948:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116955:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d0ec800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.116958:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116962:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116969:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa650385 (ffff91604e0d3000) 00010000:00010000:3.0:1769074935.116971:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.116974:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.116979:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d0ec800/0x557988ac98fec024 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaa650385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117004:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117010:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117016:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117020:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117023:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117028:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117035:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x861ef0c0 (ffff91604e0d3e00) 00010000:00010000:3.0:1769074935.117038:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117041:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117046:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fec0e8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x861ef0c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117057:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117063:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117068:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117072:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117075:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117081:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117088:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xca51a4cb (ffff91604f4f9c00) 00010000:00010000:3.0:1769074935.117089:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117092:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117098:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fec1ac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xca51a4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117111:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117115:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117121:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117126:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117128:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117133:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117139:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xaa00019 (ffff9161748d2100) 00010000:00010000:3.0:1769074935.117142:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117144:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117149:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fec25b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xaa00019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117161:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117166:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117171:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117176:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117179:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117184:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117192:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x845fa817 (ffff916052ae5c00) 00010000:00010000:3.0:1769074935.117194:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117197:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117202:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fec31f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x845fa817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117214:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117219:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117225:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117230:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117232:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117238:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117245:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x48143fc7 (ffff916052ae5800) 00010000:00010000:3.0:1769074935.117247:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117250:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117256:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fec3f8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x48143fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.117267:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117274:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117279:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117284:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117287:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117292:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117298:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x164f0d9b (ffff91604f4f9700) 00010000:00010000:3.0:1769074935.117301:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117303:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117307:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fec4bc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x164f0d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.117319:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117324:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117329:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117334:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117336:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117342:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117349:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9c8717c3 (ffff916052ae5e00) 00010000:00010000:3.0:1769074935.117351:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117355:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117359:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fec595 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9c8717c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.117371:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117376:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117381:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117385:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117388:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117393:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117399:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xdd324aa7 (ffff91604f4f9800) 00010000:00010000:3.0:1769074935.117401:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117403:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117407:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fec659 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xdd324aa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117420:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117425:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117431:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117435:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117438:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117443:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117450:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf1aaf907 (ffff91604ec3c000) 00010000:00010000:3.0:1769074935.117452:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117455:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117461:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fec708 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf1aaf907 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117473:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117478:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117483:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117490:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117492:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117497:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117503:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1af674a5 (ffff91604ec3c500) 00010000:00010000:3.0:1769074935.117505:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117507:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117512:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fec7b7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1af674a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117524:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117557:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117562:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117566:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117569:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117574:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117582:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5d8dc4b (ffff91604e58ca00) 00010000:00010000:3.0:1769074935.117585:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117588:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117912:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fec866 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5d8dc4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117932:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117938:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117944:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117948:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.117952:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117957:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117965:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x82ed4338 (ffff916052ae5f00) 00010000:00010000:3.0:1769074935.117967:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.117970:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.117975:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fec915 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x82ed4338 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118022:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118028:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118034:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118038:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118041:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118047:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118054:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x15b40051 (ffff91604ec2f400) 00010000:00010000:3.0:1769074935.118057:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118060:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118065:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fec9d9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x15b40051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118078:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118084:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118088:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118092:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118095:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118099:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118106:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x3bd2ed5d (ffff91604e58cf00) 00010000:00010000:3.0:1769074935.118108:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118110:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118115:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fecab2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x3bd2ed5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118126:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118132:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118136:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118208:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118214:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118220:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118228:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe6a72247 (ffff91604e58c300) 00010000:00010000:3.0:1769074935.118230:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118232:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118237:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423600/0x557988ac98fecb76 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe6a72247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118252:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118259:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118264:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118268:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118270:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118275:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118283:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x35736bae (ffff91604ec3cd00) 00010000:00010000:3.0:1769074935.118285:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118288:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118293:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fecc25 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x35736bae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118306:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118312:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118317:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118322:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118324:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118329:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118335:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf9bade4b (ffff91604e58c900) 00010000:00010000:3.0:1769074935.118337:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118339:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118345:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98feccd4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf9bade4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25081 initiator: MDT1 00010000:00010000:3.0:1769074935.118356:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118360:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118365:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118369:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118371:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118376:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118382:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x1829a1c9 (ffff91604e58c100) 00010000:00010000:3.0:1769074935.118383:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118386:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118390:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fecd83 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x1829a1c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118401:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118407:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118411:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118415:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118417:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118422:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118428:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xfeeb35bf (ffff916052ae5900) 00010000:00010000:3.0:1769074935.118430:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118432:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118437:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fece32 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xfeeb35bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.118449:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.118454:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.118459:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.118467:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.118469:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.118475:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.118482:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5fed3f5e (ffff91604ec3ce00) 00010000:00010000:3.0:1769074935.118484:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.118486:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119044:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fecef6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5fed3f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119069:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119075:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119081:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119086:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119089:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119095:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119103:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0b1dff5 (ffff91604464e800) 00010000:00010000:3.0:1769074935.119107:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119110:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119114:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fecfba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb0b1dff5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7534 initiator: MDT1 00010000:00010000:3.0:1769074935.119128:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119134:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119139:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119156:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119159:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119164:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119171:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3b9f081 (ffff91604e58c800) 00010000:00010000:3.0:1769074935.119174:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119177:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119182:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed069 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb3b9f081 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119197:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119203:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119208:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119213:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119216:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119221:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119228:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf51057e8 (ffff9161748d2400) 00010000:00010000:3.0:1769074935.119230:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119233:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119238:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed142 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf51057e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119250:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119256:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119272:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119278:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119280:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119286:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119293:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2f3dd4 (ffff91604f3c7000) 00010000:00010000:3.0:1769074935.119296:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119299:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119305:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed206 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2f3dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.119320:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119325:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119330:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119334:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119337:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119342:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119349:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xccf0a8ef (ffff91604ec2f600) 00010000:00010000:3.0:1769074935.119352:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119354:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119360:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed2b5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xccf0a8ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119373:0:3641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119380:0:3641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119385:0:3641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119390:0:3641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604d9b8400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.119393:0:3641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119398:0:3641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119404:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xf3cc2e14 (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.119407:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.119409:0:3641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.119415:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604d9b8400/0x557988ac98fed379 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xf3cc2e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1769074935.123610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.123701:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231808 00000100:00100000:3.0:1769074935.123712:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231808 00000100:00100000:3.0:1769074935.123780:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2863 00000100:00100000:3.0:1769074935.123791:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616231808:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.123810:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.123831:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c591 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074935.123854:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074935.123873:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.123875:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.123883:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 227 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.123899:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 227 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.123912:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:3.0:1769074935.123964:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616231808:12345-192.168.204.32@tcp:101:cp.0 Request processed in 175us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074935.123970:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2863 00000100:00080000:1.0:1769074935.124271:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769074935.128383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.128459:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616231936 00000100:00100000:2.0:1769074935.128468:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616231936 00000100:00100000:2.0:1769074935.128516:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2864 00000100:00100000:2.0:1769074935.128524:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:67923:x1855007616231936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074935.128564:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.128581:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c598 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.128619:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.128627:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.128629:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.128634:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c598 expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.128671:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.128684:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 228 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.128697:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626646400:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074935.128784:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315d80 going to sleep for 11 seconds 00000100:00100000:3.0:1769074935.131852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.131949:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232064 00000100:00100000:1.0:1769074935.131960:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232064 00010000:00010000:1.0:1769074935.132023:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:1.0:1769074935.132064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1958 00000100:00100000:1.0:1769074935.132074:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614c09e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2419:x1855007616232064:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074935.132092:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074935.132115:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074935.132130:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:1.0:1769074935.132165:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074935.132168:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074935.132176:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c598 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.132186:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c598 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.132223:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c598 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074935.132238:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626646528:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074935.132319:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f480 going to sleep for 11 seconds 00010000:00010000:2.0:1769074935.133837:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f422c00/0x557988ac98fed38e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c591 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.133858:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626646400:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074935.133885:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f200/0x557988ac98fed395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c598 expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.133899:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f200, rc 0) 00000100:00100000:2.0:1769074935.133963:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:67923:x1855007616231936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5439us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074935.133972:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2864 00000100:00100000:0.0:1769074935.137520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.137648:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232320 00000100:00100000:2.0:1769074935.137657:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232320 00000100:00100000:2.0:1769074935.137700:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1943 00000100:00100000:2.0:1769074935.137709:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+387:67923:x1855007616232320:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074935.138005:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67923:x1855007616232320:12345-192.168.204.32@tcp:35:cp.0 Request processed in 296us (493us total) trans 4294969175 rc 0/0 00000100:00100000:2.0:1769074935.138014:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1943 00000100:00100000:1.0:1769074935.141742:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626646528:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074935.141772:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074935.142007:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614c09e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616232064:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9932us (10163us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.142018:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1958 00000100:00100000:0.0:1769074935.182002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.186804:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232576 00000100:00100000:1.0:1769074935.186817:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232576 00000100:00100000:1.0:1769074935.186883:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9854 00000100:00100000:1.0:1769074935.186892:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67930:x1855007616232576:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074935.186912:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.186932:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed39c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5d7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.187005:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.187021:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187032:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187048:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.187054:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187060:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187110:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187116:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187122:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187129:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.187133:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187139:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187166:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.187169:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.187175:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187179:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187192:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187197:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187202:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187206:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.187209:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187213:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187219:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074935.187221:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.187223:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187227:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.187254:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed39c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5d7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.187262:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.187264:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.187267:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed39c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5d7 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.187275:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.187340:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67930:x1855007616232576:12345-192.168.204.32@tcp:101:bash.0 Request processed in 449us (5359us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.187348:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9854 00000100:00100000:3.0:1769074935.189139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.189459:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232448 00000100:00100000:2.0:1769074935.189468:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232448 00000100:00100000:2.0:1769074935.189559:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 299 00000100:00100000:2.0:1769074935.189569:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:2419:x1855007616232448:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074935.189635:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.189655:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed3b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c59f expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.189705:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074935.189719:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189729:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189742:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074935.189748:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189754:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189798:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189804:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189811:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189817:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.189821:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189828:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189839:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.189842:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.189846:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189852:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed3b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189865:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189871:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189876:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189881:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.189883:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189888:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189898:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916043c15900) 00010000:00010000:2.0:1769074935.189899:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.189902:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189906:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e400/0x557988ac98fed3bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.189933:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed3b1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c59f expref: 389 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.189941:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.189943:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074935.189946:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed3b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c59f expref: 389 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.189954:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ee00, rc -2) 00000100:00100000:2.0:1769074935.190025:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:2419:x1855007616232448:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 457us (892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074935.190033:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 299 00000100:00100000:0.0:1769074935.205128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.205222:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232704 00000100:00100000:3.0:1769074935.205233:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232704 00000100:00100000:3.0:1769074935.205297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9855 00000100:00100000:3.0:1769074935.205308:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67931:x1855007616232704:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074935.205329:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.205352:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed3c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.205418:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.205431:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205443:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205459:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.205465:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205472:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205527:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205577:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205582:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205588:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205602:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.205606:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205613:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205625:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.205629:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.205634:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed3cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205655:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205660:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205666:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205670:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.205673:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205679:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205685:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.205688:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.205691:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed3d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.205725:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed3c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5de expref: 389 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.205735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.205737:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.205740:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed3c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5de expref: 389 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.205754:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423000, rc 0) 00000100:00100000:3.0:1769074935.205823:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67931:x1855007616232704:12345-192.168.204.32@tcp:101:rm.0 Request processed in 517us (705us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.205831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9855 00000100:00100000:1.0:1769074935.208954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.209065:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232832 00000100:00100000:0.0:1769074935.209077:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232832 00000100:00100000:0.0:1769074935.209139:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 300 00000100:00100000:0.0:1769074935.209159:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:2417:x1855007616232832:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074935.209192:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.209211:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed3db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5e5 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.209267:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.209281:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209291:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209304:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.209310:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209316:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209360:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209368:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209374:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209380:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.209383:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209391:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209401:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.209404:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.209408:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209413:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed3e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209424:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209429:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209434:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209437:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.209440:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209444:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209450:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71251355 (ffff916052ae5b00) 00010000:00010000:0.0:1769074935.209453:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.209456:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209460:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed3e9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.209488:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed3db lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5e5 expref: 389 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.209496:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.209499:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074935.209502:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed3db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5e5 expref: 389 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.209510:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc -2) 00000100:00100000:0.0:1769074935.209621:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:2417:x1855007616232832:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 463us (679us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074935.209628:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 300 00000100:00100000:2.0:1769074935.215064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.215156:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616232960 00000100:00100000:1.0:1769074935.215168:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616232960 00000100:00100000:1.0:1769074935.215223:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9856 00000100:00100000:1.0:1769074935.215232:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67931:x1855007616232960:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.215253:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.215273:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed3f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5ec expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.215341:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.215356:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215367:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215381:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.215387:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215393:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215441:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215448:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215455:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215460:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.215465:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215471:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215483:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.215486:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.215504:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215511:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed3f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215523:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215550:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215557:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215561:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.215564:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215569:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215581:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074935.215583:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.215586:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215591:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed3fe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.215621:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed3f0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5ec expref: 389 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.215630:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.215632:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.215635:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed3f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5ec expref: 389 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.215644:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.215715:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67931:x1855007616232960:12345-192.168.204.32@tcp:101:rm.0 Request processed in 483us (661us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.215722:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9856 00000100:00100000:3.0:1769074935.235048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.235617:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233088 00000100:00100000:1.0:1769074935.235628:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233088 00000100:00100000:1.0:1769074935.235693:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9857 00000100:00100000:1.0:1769074935.235702:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67932:x1855007616233088:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.235723:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.235746:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed405 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.235822:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.235835:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235846:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235861:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.235867:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235873:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235929:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235936:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235941:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235947:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235953:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.235957:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235969:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.235990:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.235994:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.235999:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236005:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed40c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236018:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236024:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236029:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236034:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.236038:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236044:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236051:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074935.236053:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.236056:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed413 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.236090:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed405 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5f3 expref: 389 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.236099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.236101:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.236105:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed405 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5f3 expref: 389 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.236113:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074935.236191:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67932:x1855007616233088:12345-192.168.204.32@tcp:101:cp.0 Request processed in 489us (1152us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.236200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9857 00000100:00100000:2.0:1769074935.241630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.241714:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233216 00000100:00100000:0.0:1769074935.241725:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233216 00000100:00100000:0.0:1769074935.241784:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9858 00000100:00100000:0.0:1769074935.241793:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67932:x1855007616233216:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.241812:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.241835:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed41a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c5fa expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.241903:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.241916:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.241927:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.241945:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.241951:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.241957:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242018:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242026:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242033:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242038:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.242042:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242049:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242060:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.242063:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.242067:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242073:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed421 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242085:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242091:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242097:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242102:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.242104:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242109:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242116:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff916052ae5b00) 00010000:00010000:0.0:1769074935.242118:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.242120:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242125:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed428 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.242165:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed41a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5fa expref: 389 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.242176:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.242177:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.242181:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed41a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c5fa expref: 389 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.242189:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc 0) 00000100:00100000:0.0:1769074935.242253:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67932:x1855007616233216:12345-192.168.204.32@tcp:101:cp.0 Request processed in 460us (633us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.242261:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9858 00000100:00100000:2.0:1769074935.248109:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.248213:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233472 00000100:00100000:1.0:1769074935.248224:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233472 00000100:00100000:1.0:1769074935.248281:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9859 00000100:00100000:1.0:1769074935.248291:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+388:67932:x1855007616233472:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.248313:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.248333:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed42f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c601 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.248444:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.248460:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.248471:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.248488:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa077667a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.248508:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.248515:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074935.248872:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xda:0x0], index 1: 0 00010000:00010000:1.0:1769074935.249034:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed444 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074935.249043:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed444 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249050:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed444 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249081:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249088:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249093:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249099:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249105:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.249109:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249117:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.249132:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.249136:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249141:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed436 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074935.249154:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a3c19a8b reply state 000000003874010f transno 4294969176 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249164:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074935.249168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074935.249171:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074935.249173:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074935.249201:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed42f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c601 expref: 391 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.249215:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3e00/0x557988ac98fed444 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c601 expref: 390 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.249222:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1bd:0x0].0x0 (ffff91604464ef00) 00010000:00010000:1.0:1769074935.249224:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074935.249226:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3e00, rc 0) 00000100:00100000:1.0:1769074935.249285:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67932:x1855007616233472:12345-192.168.204.32@tcp:101:cp.0 Request processed in 996us (1187us total) trans 4294969176 rc 0/0 00000100:00100000:1.0:1769074935.249296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9859 00000100:00100000:3.0:1769074935.255776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.255884:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233600 00000100:00100000:2.0:1769074935.255896:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233600 00000100:00100000:2.0:1769074935.255972:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2865 00000100:00100000:2.0:1769074935.255993:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616233600:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074935.256012:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.256034:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c608 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074935.256058:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074935.256078:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.256080:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.256088:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 226 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.256105:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 226 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.256118:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:2.0:1769074935.256197:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616233600:12345-192.168.204.32@tcp:101:cp.0 Request processed in 215us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074935.256203:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2865 00000100:00080000:1.0:1769074935.256666:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074935.260064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.260259:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233728 00000100:00100000:3.0:1769074935.260269:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233728 00000100:00100000:3.0:1769074935.260322:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2866 00000100:00100000:3.0:1769074935.260332:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:67932:x1855007616233728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.260349:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.260366:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c60f expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.260396:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 227 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.260404:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.260407:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.260411:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c60f expref: 227 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.260446:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 227 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.260460:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 227 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:3.0:1769074935.260473:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626646656:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074935.260638:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91614846a240 going to sleep for 11 seconds 00000100:00100000:0.0:1769074935.264192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.264348:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616233856 00000100:00100000:2.0:1769074935.264359:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616233856 00010000:00010000:2.0:1769074935.264417:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 228 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.264461:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1959 00000100:00100000:2.0:1769074935.264471:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2419:x1855007616233856:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074935.264485:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074935.264507:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 228 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:2.0:1769074935.264528:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 228 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:2.0:1769074935.264604:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.264607:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.264614:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c60f expref: 228 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.264625:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c60f expref: 228 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.264663:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c60f expref: 228 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074935.264677:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626646784:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074935.264762:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315300 going to sleep for 11 seconds 00010000:00010000:3.0:1769074935.265173:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98fed452 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c608 expref: 228 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:3.0:1769074935.265188:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24564:1855007626646656:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074935.265211:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f423600/0x557988ac98fed459 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c60f expref: 227 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.265220:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423600, rc 0) 00000100:00100000:3.0:1769074935.265264:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:67932:x1855007616233728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4933us (5210us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074935.265272:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2866 00000100:00100000:0.0:1769074935.273883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.274014:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626646784:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074935.274038:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074935.274102:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616233856:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9631us (9921us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074935.274112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1959 00000100:00100000:3.0:1769074935.274583:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234112 00000100:00100000:3.0:1769074935.274601:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234112 00000100:00100000:3.0:1769074935.274645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1944 00000100:00100000:3.0:1769074935.274653:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+391:67932:x1855007616234112:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074935.274945:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67932:x1855007616234112:12345-192.168.204.32@tcp:35:cp.0 Request processed in 292us (1074us total) trans 4294969177 rc 0/0 00000100:00100000:3.0:1769074935.274952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1944 00000100:00100000:0.0:1769074935.313850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.314350:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234240 00000100:00100000:1.0:1769074935.314360:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234240 00000100:00100000:1.0:1769074935.314424:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9860 00000100:00100000:1.0:1769074935.314433:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181014450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67935:x1855007616234240:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074935.314454:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.314477:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed460 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c616 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.314676:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.314691:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314702:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314717:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.314723:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314728:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314785:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314792:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314799:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314805:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.314809:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314817:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314828:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.314831:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.314836:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314842:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed467 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314855:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314860:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314865:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314870:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.314872:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314878:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314890:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff91604464e000) 00010000:00010000:1.0:1769074935.314892:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.314895:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314900:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed46e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.314932:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed460 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c616 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.314942:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.314944:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.314948:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed460 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c616 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.314956:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074935.315027:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181014450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67935:x1855007616234240:12345-192.168.204.32@tcp:101:bash.0 Request processed in 594us (1185us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.315034:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9860 00000100:00100000:1.0:1769074935.331333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.331382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.331467:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234496 00000100:00100000:2.0:1769074935.331478:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234496 00000100:00100000:2.0:1769074935.331568:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 301 00000100:00100000:2.0:1769074935.331578:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:2417:x1855007616234496:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074935.331626:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.331645:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed475 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c624 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.331696:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074935.331709:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331719:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331732:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074935.331737:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331743:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331791:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331798:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331804:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331809:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.331813:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331824:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331834:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.331837:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.331842:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331848:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fed47c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331861:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331866:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331872:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331876:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.331879:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331885:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331892:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x50cbaa19 (ffff916043c15300) 00010000:00010000:2.0:1769074935.331895:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.331898:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331903:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed483 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074935.331930:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed475 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c624 expref: 393 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.331939:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.331941:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074935.331944:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed475 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c624 expref: 393 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.331952:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc -2) 00000100:00100000:2.0:1769074935.332023:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:2417:x1855007616234496:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 446us (640us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074935.332031:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 301 00000100:00100000:0.0:1769074935.332183:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234368 00000100:00100000:0.0:1769074935.332189:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234368 00000100:00100000:0.0:1769074935.332229:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9861 00000100:00100000:0.0:1769074935.332237:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67936:x1855007616234368:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074935.332245:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.332255:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed48a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c61d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.332285:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.332294:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332302:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332314:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.332320:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332326:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332355:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332363:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332369:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332374:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.332376:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332382:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332389:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.332391:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.332394:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332399:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed491 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332409:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332414:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332419:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332424:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.332426:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332436:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332442:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916052ae5b00) 00010000:00010000:0.0:1769074935.332445:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.332447:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332452:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed498 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.332472:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed48a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c61d expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.332481:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.332483:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.332487:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed48a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c61d expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.332494:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eec00, rc 0) 00000100:00100000:0.0:1769074935.332523:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67936:x1855007616234368:12345-192.168.204.32@tcp:101:rm.0 Request processed in 287us (1199us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.332566:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9861 00000100:00100000:1.0:1769074935.337641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.337783:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234624 00000100:00100000:2.0:1769074935.337795:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234624 00000100:00100000:2.0:1769074935.337848:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9862 00000100:00100000:2.0:1769074935.337858:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67936:x1855007616234624:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074935.337877:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.337898:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed49f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c62b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.337966:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074935.337991:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338002:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338020:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074935.338027:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338034:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338086:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338093:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338098:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338103:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338109:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.338113:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338120:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.338134:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.338150:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338156:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed4a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338171:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338176:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338183:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338187:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.338190:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338195:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338202:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916043c15000) 00010000:00010000:2.0:1769074935.338205:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.338207:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338212:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed4ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.338243:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed49f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c62b expref: 393 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.338254:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.338256:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.338259:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e000/0x557988ac98fed49f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c62b expref: 393 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.338272:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e000, rc 0) 00000100:00100000:2.0:1769074935.338332:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67936:x1855007616234624:12345-192.168.204.32@tcp:101:rm.0 Request processed in 475us (700us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074935.338339:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9862 00000100:00100000:2.0:1769074935.361402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.362170:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234752 00000100:00100000:0.0:1769074935.362182:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234752 00000100:00100000:0.0:1769074935.362251:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9863 00000100:00100000:0.0:1769074935.362261:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67937:x1855007616234752:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.362279:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.362299:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed4b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c632 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.362365:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.362378:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362388:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362402:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.362408:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362415:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362465:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362472:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362478:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362484:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.362488:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362506:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362518:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.362521:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.362525:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362568:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed4bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362581:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362587:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362988:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.362993:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.362996:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.363001:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.363010:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916052ae5b00) 00010000:00010000:0.0:1769074935.363012:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.363015:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.363020:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed4c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.363055:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed4b4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c632 expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.363065:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.363067:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.363071:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed4b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c632 expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.363080:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eec00, rc 0) 00000100:00100000:0.0:1769074935.363961:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67937:x1855007616234752:12345-192.168.204.32@tcp:101:cp.0 Request processed in 877us (1745us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.363974:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9863 00000100:00100000:3.0:1769074935.366858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.367168:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616234880 00000100:00100000:0.0:1769074935.367178:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616234880 00000100:00100000:0.0:1769074935.367237:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9864 00000100:00100000:0.0:1769074935.367247:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67937:x1855007616234880:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.367265:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.367284:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed4c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c639 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.367350:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.367364:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367375:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367390:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.367402:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367408:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367454:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367461:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367467:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367474:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.367478:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367485:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367495:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.367498:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.367503:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367508:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed4d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367521:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367526:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367555:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367560:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.367563:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367569:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367576:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916052ae5900) 00010000:00010000:0.0:1769074935.367578:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.367581:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367704:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed4d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.367738:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed4c9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c639 expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.367748:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.367751:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.367755:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed4c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c639 expref: 393 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.367764:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074935.368145:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67937:x1855007616234880:12345-192.168.204.32@tcp:101:cp.0 Request processed in 897us (1305us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.368154:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9864 00000100:00100000:1.0:1769074935.379249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.379399:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235136 00000100:00100000:0.0:1769074935.379412:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235136 00000100:00100000:0.0:1769074935.379474:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9865 00000100:00100000:0.0:1769074935.379484:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+392:67937:x1855007616235136:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.379515:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.379576:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed4de lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c640 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.379932:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.379949:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.379960:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.379973:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074935.379989:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074935.379996:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074935.380717:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xda:0x0], index 0: 0 00010000:00010000:1.0:1769074935.381113:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed4f3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.381124:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381133:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381175:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381182:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381188:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381194:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.381198:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381205:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381217:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.381221:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.381225:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381230:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed4e5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074935.381244:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000063b7064b reply state 000000001ba4f8a5 transno 4294969178 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381254:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.381260:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916052ae5f00) 00010000:00010000:1.0:1769074935.381263:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074935.381266:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074935.381297:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed4de lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c640 expref: 395 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.381311:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3600/0x557988ac98fed4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c640 expref: 394 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.381318:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1be:0x0].0x0 (ffff91604464e000) 00010000:00010000:1.0:1769074935.381320:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074935.381323:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3600, rc 0) 00000100:00100000:1.0:1769074935.381453:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67937:x1855007616235136:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1969us (2216us total) trans 4294969178 rc 0/0 00000100:00100000:1.0:1769074935.381463:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9865 00000100:00100000:3.0:1769074935.386159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.386249:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235264 00000100:00100000:0.0:1769074935.386259:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235264 00000100:00100000:0.0:1769074935.386317:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2867 00000100:00100000:0.0:1769074935.386326:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616235264:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.386344:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.386364:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c647 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074935.386388:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074935.386407:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.386409:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.386418:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.386434:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.386447:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074935.386510:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2419:x1855007616235264:12345-192.168.204.32@tcp:101:cp.0 Request processed in 185us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.386518:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2867 00000100:00100000:3.0:1769074935.390636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.390800:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235392 00000100:00100000:2.0:1769074935.390811:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235392 00000100:00100000:2.0:1769074935.390864:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2868 00000100:00100000:2.0:1769074935.390874:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:67937:x1855007616235392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074935.390893:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.390912:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c64e expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.390944:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.390951:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.390953:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.390958:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c64e expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.391003:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.391017:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.391036:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041e69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626646912:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074935.391146:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315600 going to sleep for 11 seconds 00000100:00100000:2.0:1769074935.394324:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041e69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:25313:1855007626646912:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074935.394361:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c64e expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.394381:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e000, rc 0) 00000100:00100000:2.0:1769074935.394447:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:67937:x1855007616235392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3575us (3821us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074935.394456:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2868 00000100:00100000:3.0:1769074935.395970:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.397451:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235520 00000100:00100000:0.0:1769074935.397463:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235520 00010000:00010000:0.0:1769074935.397688:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00000100:00100000:0.0:1769074935.397794:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1960 00000100:00100000:0.0:1769074935.397804:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2420:x1855007616235520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074935.397820:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074935.397841:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:0.0:1769074935.397856:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:0.0:1769074935.397882:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c647 expref: 229 pid: 24564 timeout: 2024 lvb_type: 1 00010000:00010000:0.0:1769074935.397897:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.397900:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.397907:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c64e expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.397916:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c64e expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.397956:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9e000/0x557988ac98fed508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c64e expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074935.397970:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626647040:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074935.398070:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1769074935.402958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.403066:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235776 00000100:00100000:1.0:1769074935.403077:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235776 00000100:00100000:1.0:1769074935.403135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1945 00000100:00100000:1.0:1769074935.403153:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+395:67937:x1855007616235776:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074935.403494:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67937:x1855007616235776:12345-192.168.204.32@tcp:35:cp.0 Request processed in 343us (545us total) trans 4294969179 rc 0/0 00000100:00100000:1.0:1769074935.403501:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1945 00000100:00100000:3.0:1769074935.403901:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626647040:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074935.403928:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074935.411390:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616235520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 13575us (15414us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074935.411408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1960 00000100:00100000:2.0:1769074935.443722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.443882:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616235904 00000100:00100000:1.0:1769074935.443893:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616235904 00000100:00100000:1.0:1769074935.443956:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9866 00000100:00100000:1.0:1769074935.443967:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67940:x1855007616235904:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074935.444015:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.444040:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed50f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c655 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.444111:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.444125:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444136:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444162:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.444169:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444175:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444227:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444233:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444238:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444244:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.444248:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444258:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444269:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.444273:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.444277:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444282:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed516 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444294:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444300:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444305:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444310:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.444313:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444318:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444324:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604464e300) 00010000:00010000:1.0:1769074935.444327:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.444330:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444335:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed51d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.444366:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed50f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c655 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.444377:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.444379:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.444382:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed50f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c655 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.444391:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc 0) 00000100:00100000:1.0:1769074935.444452:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67940:x1855007616235904:12345-192.168.204.32@tcp:101:bash.0 Request processed in 487us (742us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.444459:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9866 00000100:00100000:2.0:1769074935.458801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.458846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.458929:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236032 00000100:00100000:3.0:1769074935.458941:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236032 00000100:00100000:3.0:1769074935.459014:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9867 00000100:00100000:3.0:1769074935.459025:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67941:x1855007616236032:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074935.459050:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.459071:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed524 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c65c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.459135:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.459159:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459170:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459185:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.459193:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459199:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459255:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459262:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459269:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459274:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459280:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.459284:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459291:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459304:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.459307:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.459312:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459318:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed52b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459332:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459338:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459343:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459347:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.459350:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459359:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459366:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.459368:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.459370:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459376:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed532 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.459405:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed524 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c65c expref: 397 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.459416:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.459419:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.459422:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed524 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c65c expref: 397 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.459430:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074935.459484:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67941:x1855007616236032:12345-192.168.204.32@tcp:101:rm.0 Request processed in 461us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.459491:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9867 00000100:00100000:1.0:1769074935.460909:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236160 00000100:00100000:1.0:1769074935.460920:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236160 00000100:00100000:1.0:1769074935.460988:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 302 00000100:00100000:1.0:1769074935.460998:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:2419:x1855007616236160:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074935.461048:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.461066:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed539 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c663 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.461114:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.461127:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461135:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461165:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.461171:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461177:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461225:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461232:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461237:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461242:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.461245:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461252:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461262:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.461265:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.461269:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461274:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed540 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461285:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461291:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461295:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461300:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.461302:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461307:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461312:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604464e300) 00010000:00010000:1.0:1769074935.461315:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.461317:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461322:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed547 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.461346:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed539 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c663 expref: 397 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.461355:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.461357:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074935.461360:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed539 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c663 expref: 397 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.461368:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc -2) 00000100:00100000:1.0:1769074935.461436:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:2419:x1855007616236160:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 439us (2588us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074935.461444:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 302 00000100:00100000:2.0:1769074935.467047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.467131:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236288 00000100:00100000:1.0:1769074935.467151:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236288 00000100:00100000:1.0:1769074935.467214:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9868 00000100:00100000:1.0:1769074935.467223:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67941:x1855007616236288:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.467244:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.467267:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed54e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c69b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.467329:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.467344:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467355:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467370:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.467376:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467382:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467430:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467437:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467443:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467448:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.467453:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467460:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467472:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.467474:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.467479:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467485:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed555 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467496:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467502:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467507:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467512:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.467515:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467522:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467570:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604464e500) 00010000:00010000:1.0:1769074935.467573:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.467576:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467582:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed55c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.467620:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed54e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c69b expref: 397 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.467630:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.467632:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.467636:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed54e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c69b expref: 397 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.467644:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2000, rc 0) 00000100:00100000:1.0:1769074935.467695:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67941:x1855007616236288:12345-192.168.204.32@tcp:101:rm.0 Request processed in 472us (659us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.467703:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9868 00000100:00100000:3.0:1769074935.486346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.486399:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.486733:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236416 00000100:00100000:0.0:1769074935.486745:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236416 00000100:00100000:0.0:1769074935.486806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9869 00000100:00100000:0.0:1769074935.486816:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67944:x1855007616236416:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.486835:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.486856:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed563 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.486923:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.486941:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.486950:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.486964:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.486970:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.486988:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487042:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487048:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487054:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487059:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487065:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.487068:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487075:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487090:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.487093:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.487098:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487103:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed56a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487116:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487122:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487128:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487133:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.487136:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487155:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487161:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff916052ae5e00) 00010000:00010000:0.0:1769074935.487163:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.487165:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487170:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed571 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.487198:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed563 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6a2 expref: 397 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.487208:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.487210:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.487213:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed563 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6a2 expref: 397 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.487220:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef400, rc 0) 00000100:00100000:0.0:1769074935.487274:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67944:x1855007616236416:12345-192.168.204.32@tcp:101:cp.0 Request processed in 459us (937us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.487281:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9869 00000100:00100000:1.0:1769074935.487649:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236544 00000100:00100000:1.0:1769074935.487655:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236544 00000100:00100000:1.0:1769074935.487689:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 303 00000100:00100000:1.0:1769074935.487696:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:2419:x1855007616236544:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074935.487739:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.487752:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed578 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6a9 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.487789:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074935.487798:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487806:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487817:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:1.0:1769074935.487822:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487828:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487855:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487862:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487867:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487872:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.487876:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487883:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487895:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.487898:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.487900:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487905:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed57f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487914:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487919:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487925:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487930:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.487932:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487938:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487944:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604464e500) 00010000:00010000:1.0:1769074935.487946:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.487949:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487953:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed586 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:1.0:1769074935.487974:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed578 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6a9 expref: 397 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.487993:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.487995:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074935.487998:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed578 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6a9 expref: 397 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.488006:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2000, rc -2) 00000100:00100000:1.0:1769074935.488042:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:2419:x1855007616236544:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 345us (1642us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074935.488048:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 303 00000100:00100000:0.0:1769074935.496502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.497278:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236672 00000100:00100000:3.0:1769074935.497290:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236672 00000100:00100000:3.0:1769074935.497357:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9870 00000100:00100000:3.0:1769074935.497367:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67944:x1855007616236672:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.497388:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.497410:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed58d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6e1 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.497482:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074935.497510:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.497521:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.497559:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074935.497566:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.497571:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498869:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498882:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498889:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498896:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.498901:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498912:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498926:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.498929:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.498934:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498940:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed594 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498953:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498959:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498964:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498968:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.498971:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498985:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.498993:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.498996:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.498999:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.499004:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed59b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.499047:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed58d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6e1 expref: 397 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.499058:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.499060:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.499064:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed58d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6e1 expref: 397 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.499074:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc 0) 00000100:00100000:3.0:1769074935.499152:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67944:x1855007616236672:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1785us (2658us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.499160:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9870 00000100:00100000:3.0:1769074935.504236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.504397:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616236928 00000100:00100000:1.0:1769074935.504408:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616236928 00000100:00100000:1.0:1769074935.504474:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9871 00000100:00100000:1.0:1769074935.504485:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+396:67944:x1855007616236928:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.504518:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.504898:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed5a2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6e8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.505037:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.505052:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.505064:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.505080:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.505090:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.505097:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074935.505475:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xdb:0x0], index 1: 0 00010000:00010000:1.0:1769074935.506016:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed5b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.506030:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed5b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506038:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed5b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506070:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506076:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506082:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506087:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.506091:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506098:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506109:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.506113:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.506117:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506122:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5a9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074935.506135:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5ec2c8a reply state 00000000ae5b2801 transno 4294969180 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506313:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.506319:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604464e500) 00010000:00010000:1.0:1769074935.506321:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074935.506324:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074935.506357:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed5a2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6e8 expref: 399 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.506371:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2200/0x557988ac98fed5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6e8 expref: 398 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.506378:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1bf:0x0].0x0 (ffff91604464e300) 00010000:00010000:1.0:1769074935.506381:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074935.506383:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2200, rc 0) 00000100:00100000:1.0:1769074935.506506:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67944:x1855007616236928:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2021us (2278us total) trans 4294969180 rc 0/0 00000100:00100000:1.0:1769074935.506515:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9871 00000100:00100000:2.0:1769074935.511372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.511458:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237056 00000100:00100000:0.0:1769074935.511468:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237056 00000100:00100000:0.0:1769074935.511830:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2869 00000100:00100000:0.0:1769074935.511840:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616237056:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.511859:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.511881:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6ef expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074935.511906:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074935.511924:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.511926:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.511934:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 227 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.511949:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 227 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.511967:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef800, rc 0) 00000100:00100000:0.0:1769074935.512041:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616237056:12345-192.168.204.32@tcp:101:cp.0 Request processed in 202us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.512048:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2869 00000100:00100000:0.0:1769074935.516139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.516230:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237184 00000100:00100000:2.0:1769074935.516241:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237184 00000100:00100000:2.0:1769074935.516298:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2870 00000100:00100000:2.0:1769074935.516308:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:67944:x1855007616237184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074935.516326:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.516344:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6f6 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.516377:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 228 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.516385:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.516387:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.516391:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6f6 expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.516424:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 228 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074935.516438:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 228 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.516451:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626647168:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074935.516581:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315600 going to sleep for 11 seconds 00000100:00100000:1.0:1769074935.520100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.520262:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237312 00000100:00100000:0.0:1769074935.520271:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237312 00010000:00010000:0.0:1769074935.520324:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 229 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:0.0:1769074935.520364:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1961 00000100:00100000:0.0:1769074935.520373:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2420:x1855007616237312:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074935.520387:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074935.520406:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 229 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:0.0:1769074935.520421:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 229 pid: 25313 timeout: 2024 lvb_type: 1 00010000:00010000:0.0:1769074935.520445:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.520447:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.520454:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6f6 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.520463:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6f6 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.520518:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6f6 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074935.520574:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626647296:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074935.520656:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6480 going to sleep for 11 seconds 00010000:00010000:2.0:1769074935.521627:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f1ef800/0x557988ac98fed5c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6ef expref: 229 pid: 25313 timeout: 2024 lvb_type: 1 00000100:00100000:2.0:1769074935.521646:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626647168:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074935.521672:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e400/0x557988ac98fed5cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6f6 expref: 228 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.521685:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e400, rc 0) 00000100:00100000:2.0:1769074935.521741:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:67944:x1855007616237184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5433us (5609us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074935.521750:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2870 00000100:00100000:0.0:1769074935.525812:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626647296:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074935.525843:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074935.525897:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2420:x1855007616237312:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5524us (5806us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.525907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1961 00000100:00100000:0.0:1769074935.529493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.529624:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237568 00000100:00100000:3.0:1769074935.529636:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237568 00000100:00100000:3.0:1769074935.529697:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1946 00000100:00100000:3.0:1769074935.529707:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+399:67944:x1855007616237568:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074935.530030:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67944:x1855007616237568:12345-192.168.204.32@tcp:35:cp.0 Request processed in 324us (547us total) trans 4294969181 rc 0/0 00000100:00100000:3.0:1769074935.530039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1946 00000100:00100000:1.0:1769074935.560835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.561263:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237696 00000100:00100000:0.0:1769074935.561275:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237696 00000100:00100000:0.0:1769074935.561336:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 304 00000100:00100000:0.0:1769074935.561347:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2420:x1855007616237696:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074935.561413:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.561434:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed5d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c6fd expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.561505:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.561520:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561574:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561732:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074935.561742:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561749:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561803:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561810:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561817:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561823:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.561827:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561836:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561848:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.561851:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.561856:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561862:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed5da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561875:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561881:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561888:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561893:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.561896:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561901:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561907:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff916052ae5c00) 00010000:00010000:0.0:1769074935.561909:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.561911:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561916:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed5e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074935.561944:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed5d3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6fd expref: 401 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.561952:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.561954:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074935.561958:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed5d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c6fd expref: 401 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.561966:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efa00, rc -2) 00000100:00100000:0.0:1769074935.562100:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2420:x1855007616237696:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 754us (1274us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074935.562108:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 304 00000100:00100000:2.0:1769074935.595765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.595864:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237824 00000100:00100000:1.0:1769074935.595874:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237824 00000100:00100000:1.0:1769074935.595938:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9872 00000100:00100000:1.0:1769074935.595947:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67952:x1855007616237824:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074935.595967:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.595998:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5e8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c735 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.596060:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.596074:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596085:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596101:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.596106:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596112:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596304:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596311:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596316:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596326:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.596330:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596336:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596347:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.596350:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.596355:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596361:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed5ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596373:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596378:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596384:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596388:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.596391:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596396:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596402:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff91604464e900) 00010000:00010000:1.0:1769074935.596404:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.596407:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596412:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed5f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.596441:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5e8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c735 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.596449:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.596452:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.596455:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c735 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.596463:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074935.596619:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67952:x1855007616237824:12345-192.168.204.32@tcp:101:bash.0 Request processed in 672us (862us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.596627:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9872 00000100:00100000:2.0:1769074935.613790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.613863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.613961:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616237952 00000100:00100000:1.0:1769074935.613972:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616237952 00000100:00100000:1.0:1769074935.614046:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9873 00000100:00100000:1.0:1769074935.614057:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67953:x1855007616237952:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.614076:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.614097:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c73c expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.614167:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.614181:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614191:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614205:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.614212:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614218:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614269:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614276:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614282:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614288:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.614292:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614299:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614311:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.614315:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.614319:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614325:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed604 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614337:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614343:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614348:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614352:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.614355:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614359:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614366:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff91604464e900) 00010000:00010000:1.0:1769074935.614369:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.614371:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614376:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed60b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.614407:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5fd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c73c expref: 401 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.614416:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.614418:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.614421:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed5fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c73c expref: 401 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.614434:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074935.614507:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67953:x1855007616237952:12345-192.168.204.32@tcp:101:rm.0 Request processed in 439us (714us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.614514:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9873 00000100:00100000:3.0:1769074935.614896:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238080 00000100:00100000:3.0:1769074935.614903:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238080 00000100:00100000:3.0:1769074935.614946:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 305 00000100:00100000:3.0:1769074935.614955:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2418:x1855007616238080:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074935.615007:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.615021:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed612 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c743 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.615060:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074935.615070:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615079:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615091:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074935.615097:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615103:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615145:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615152:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615158:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615163:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.615167:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615172:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615181:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.615183:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.615187:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615193:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed619 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615203:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615208:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615213:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615218:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.615221:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615227:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615233:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xda3247e6 (ffff91604ec2fc00) 00010000:00010000:3.0:1769074935.615235:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.615237:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615243:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed620 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074935.615262:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed612 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c743 expref: 401 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.615271:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.615274:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074935.615277:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed612 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c743 expref: 401 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.615286:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc -2) 00000100:00100000:3.0:1769074935.615329:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2418:x1855007616238080:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 375us (1466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074935.615337:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 305 00000100:00100000:2.0:1769074935.619901:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.619984:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238208 00000100:00100000:3.0:1769074935.619995:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238208 00000100:00100000:3.0:1769074935.620049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9874 00000100:00100000:3.0:1769074935.620059:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67953:x1855007616238208:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074935.620079:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.620098:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed627 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c74a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.620176:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.620191:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620202:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620217:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074935.620227:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620233:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620287:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620295:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620301:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620307:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620312:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.620316:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620323:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620335:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.620338:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.620342:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620348:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed62e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620359:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620365:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620370:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620374:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.620377:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620382:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620389:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff91604ec2f600) 00010000:00010000:3.0:1769074935.620391:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.620393:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620399:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed635 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074935.620425:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed627 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c74a expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.620435:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.620437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.620440:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423000/0x557988ac98fed627 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c74a expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.620449:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423000, rc 0) 00000100:00100000:3.0:1769074935.620808:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67953:x1855007616238208:12345-192.168.204.32@tcp:101:rm.0 Request processed in 748us (914us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.620816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9874 00000100:00100000:2.0:1769074935.640695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.640786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.641083:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238464 00000100:00100000:1.0:1769074935.641093:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238464 00000100:00100000:1.0:1769074935.641164:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 306 00000100:00100000:1.0:1769074935.641174:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2420:x1855007616238464:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074935.641209:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.641231:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed63c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c758 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.641285:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.641299:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641310:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641324:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.641330:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641336:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641391:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641398:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641405:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641411:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.641415:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641422:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641432:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.641436:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.641440:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641446:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed643 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641458:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641462:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641466:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641470:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.641473:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641478:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641484:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xda3247e6 (ffff91604464e900) 00010000:00010000:1.0:1769074935.641487:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.641489:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641505:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fed64a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.641579:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed63c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c758 expref: 401 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.641589:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.641592:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074935.641596:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed63c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c758 expref: 401 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.641606:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc -2) 00000100:00100000:1.0:1769074935.641667:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:2420:x1855007616238464:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 494us (880us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074935.641675:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 306 00000100:00100000:3.0:1769074935.644397:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238336 00000100:00100000:3.0:1769074935.644415:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238336 00000100:00100000:2.0:1769074935.645032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9875 00000100:00100000:2.0:1769074935.645043:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67954:x1855007616238336:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074935.645065:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074935.645085:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed651 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c751 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.645162:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074935.645176:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645188:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645203:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074935.645210:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645216:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645272:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645278:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645284:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645290:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645295:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.645299:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645306:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645317:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.645320:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.645325:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645330:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed658 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645343:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645349:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645355:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645360:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074935.645363:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645369:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645375:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916043c15000) 00010000:00010000:2.0:1769074935.645377:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.645380:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645384:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed65f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074935.645415:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed651 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c751 expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.645424:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074935.645426:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074935.645430:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed651 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c751 expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.645438:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:2.0:1769074935.645669:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67954:x1855007616238336:12345-192.168.204.32@tcp:101:cp.0 Request processed in 624us (4980us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074935.645678:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9875 00000100:00100000:2.0:1769074935.651210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.651302:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238592 00000100:00100000:0.0:1769074935.651313:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238592 00000100:00100000:0.0:1769074935.651378:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9876 00000100:00100000:0.0:1769074935.651388:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67954:x1855007616238592:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.651407:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.651428:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed666 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c75f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.651501:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.651515:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651802:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651823:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.651831:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651838:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651889:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651896:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651903:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651910:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651916:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.651920:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651927:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651939:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.651942:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.651947:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651954:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed66d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651967:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651983:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651989:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.651994:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.651997:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.652008:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.652015:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916052ae5c00) 00010000:00010000:0.0:1769074935.652018:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.652021:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.652026:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed674 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.652058:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed666 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c75f expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.652067:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.652069:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.652073:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed666 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c75f expref: 401 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.652081:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee000, rc 0) 00000100:00100000:0.0:1769074935.652139:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67954:x1855007616238592:12345-192.168.204.32@tcp:101:cp.0 Request processed in 753us (938us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.652147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9876 00000100:00100000:3.0:1769074935.659023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.659211:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238848 00000100:00100000:0.0:1769074935.659221:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238848 00000100:00100000:0.0:1769074935.659276:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9877 00000100:00100000:0.0:1769074935.659285:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+400:67954:x1855007616238848:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.659304:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.659325:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed67b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c766 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.659443:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.659458:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.659470:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.659483:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.659489:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.659494:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074935.659847:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xdb:0x0], index 0: 0 00010000:00010000:0.0:1769074935.659998:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed690 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.660007:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed690 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660013:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed690 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660042:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660048:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660054:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660059:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660064:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.660069:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660075:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660085:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.660088:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.660091:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660096:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed682 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074935.660108:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000039ffc7ac reply state 0000000013a3777e transno 4294969182 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660116:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.660121:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916052ae5c00) 00010000:00010000:0.0:1769074935.660124:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074935.660126:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074935.660151:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed67b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c766 expref: 403 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.660167:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef800/0x557988ac98fed690 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c766 expref: 402 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.660173:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c0:0x0].0x0 (ffff91604e0d3e00) 00010000:00010000:0.0:1769074935.660176:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074935.660178:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef800, rc 0) 00000100:00100000:0.0:1769074935.660236:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67954:x1855007616238848:12345-192.168.204.32@tcp:101:cp.0 Request processed in 952us (1223us total) trans 4294969182 rc 0/0 00000100:00100000:0.0:1769074935.660243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9877 00000100:00100000:2.0:1769074935.667450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.667565:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616238976 00000100:00100000:0.0:1769074935.667576:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616238976 00000100:00100000:0.0:1769074935.667822:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2871 00000100:00100000:0.0:1769074935.667831:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616238976:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.667850:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.667870:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c76d expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074935.667894:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074935.667912:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.667915:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.667923:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 229 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.667941:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 229 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.667958:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee000, rc 0) 00000100:00100000:0.0:1769074935.668030:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2420:x1855007616238976:12345-192.168.204.32@tcp:101:cp.0 Request processed in 200us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.668038:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2871 00000100:00100000:2.0:1769074935.672871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.673116:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239104 00000100:00100000:3.0:1769074935.673126:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239104 00000100:00100000:3.0:1769074935.673191:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2872 00000100:00100000:3.0:1769074935.673201:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:67954:x1855007616239104:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.673218:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.673236:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c774 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.673263:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.673272:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.673274:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.673277:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c774 expref: 230 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.673313:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.673326:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 2025 lvb_type: 1 00000100:00100000:3.0:1769074935.673340:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160437baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626647424:192.168.204.32@tcp:104: 00000100:00100000:3.0:1769074935.673454:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604f4a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074935.677276:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160437baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626647424:192.168.204.32@tcp:104: 00010000:00010000:3.0:1769074935.677315:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c774 expref: 230 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.677332:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423000, rc 0) 00000100:00100000:3.0:1769074935.677392:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:67954:x1855007616239104:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4192us (4531us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074935.677401:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2872 00000100:00100000:2.0:1769074935.680613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.680786:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239232 00000100:00100000:0.0:1769074935.680796:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239232 00010000:00010000:0.0:1769074935.680851:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074935.680893:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1962 00000100:00100000:0.0:1769074935.680902:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2420:x1855007616239232:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074935.680915:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074935.680936:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 2025 lvb_type: 1 00010000:00010000:0.0:1769074935.680951:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 2025 lvb_type: 1 00010000:00010000:0.0:1769074935.680986:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee000/0x557988ac98fed69e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c76d expref: 230 pid: 25313 timeout: 2025 lvb_type: 1 00010000:00010000:0.0:1769074935.681003:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.681005:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.681012:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c774 expref: 229 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.681028:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c774 expref: 229 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.681065:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f423000/0x557988ac98fed6a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c774 expref: 229 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074935.681079:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626647552:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074935.681181:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6600 going to sleep for 11 seconds 00000100:00100000:2.0:1769074935.687929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.688052:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626647552:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074935.688076:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074935.688144:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2420:x1855007616239232:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7235us (7550us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.688154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1962 00000100:00100000:1.0:1769074935.688244:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239488 00000100:00100000:1.0:1769074935.688253:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239488 00000100:00100000:1.0:1769074935.688299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1947 00000100:00100000:1.0:1769074935.688307:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+403:67954:x1855007616239488:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074935.688594:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67954:x1855007616239488:12345-192.168.204.32@tcp:35:cp.0 Request processed in 276us (663us total) trans 4294969183 rc 0/0 00000100:00100000:1.0:1769074935.688810:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1947 00000040:00080000:2.0:1769074935.731767:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1769074935.731775:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769074935.734885:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1769074935.734906:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1769074935.736985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.737065:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239616 00000100:00100000:3.0:1769074935.737077:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239616 00000100:00100000:3.0:1769074935.737151:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9878 00000100:00100000:3.0:1769074935.737160:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67957:x1855007616239616:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074935.737181:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.737201:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed6ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c77b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.737265:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074935.737279:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737290:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737303:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074935.737309:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737315:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737364:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737371:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737377:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737383:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.737387:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737395:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737406:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.737410:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.737415:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737421:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed6b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737432:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737438:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737443:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737449:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074935.737451:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737457:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737464:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604ec2f600) 00010000:00010000:3.0:1769074935.737466:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.737469:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737474:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed6ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074935.737517:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed6ac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c77b expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.737527:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074935.737630:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074935.737635:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed6ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c77b expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074935.737645:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:3.0:1769074935.737701:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67957:x1855007616239616:12345-192.168.204.32@tcp:101:bash.0 Request processed in 542us (735us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074935.737707:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9878 00000100:00100000:2.0:1769074935.749706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.749808:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239872 00000100:00100000:0.0:1769074935.749819:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239872 00000100:00100000:0.0:1769074935.749883:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 307 00000100:00100000:0.0:1769074935.749894:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:2417:x1855007616239872:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074935.749934:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.749954:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed6c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c782 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.750021:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074935.750035:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750046:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750064:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074935.750070:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750075:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750125:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750143:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750150:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750156:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.750160:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750167:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750179:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.750183:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.750187:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750194:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed6c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750208:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750214:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750219:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750223:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.750226:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750231:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750238:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71251355 (ffff91604f4f6d00) 00010000:00010000:0.0:1769074935.750240:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.750242:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750248:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed6cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.750273:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed6c1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c782 expref: 405 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.750282:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.750284:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074935.750288:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed6c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c782 expref: 405 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.750301:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee000, rc -2) 00000100:00100000:0.0:1769074935.750370:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:2417:x1855007616239872:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 478us (673us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074935.750378:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 307 00000100:00100000:1.0:1769074935.754027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.754263:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616239744 00000100:00100000:0.0:1769074935.754274:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616239744 00000100:00100000:0.0:1769074935.754333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9879 00000100:00100000:0.0:1769074935.754342:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67958:x1855007616239744:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:0.0:1769074935.754362:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.754382:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed6d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c789 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.754446:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.754459:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754470:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754486:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.754492:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754498:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754595:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754602:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754609:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754613:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754619:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.754624:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754630:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754639:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.754642:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.754646:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754651:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed6dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754664:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754670:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754675:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754679:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.754681:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754687:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754692:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604faeb000) 00010000:00010000:0.0:1769074935.754694:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.754696:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed6e4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.754734:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed6d6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c789 expref: 405 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.754742:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.754744:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.754748:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed6d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c789 expref: 405 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.754755:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eec00, rc 0) 00000100:00100000:0.0:1769074935.754810:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67958:x1855007616239744:12345-192.168.204.32@tcp:101:rm.0 Request processed in 469us (793us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.754817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9879 00000100:00100000:3.0:1769074935.764836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.764942:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240000 00000100:00100000:1.0:1769074935.764952:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240000 00000100:00100000:1.0:1769074935.765042:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9880 00000100:00100000:1.0:1769074935.765052:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67958:x1855007616240000:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.765073:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.765094:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed6eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c790 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.765175:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.765190:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765200:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765213:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.765219:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765225:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765281:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765288:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765293:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765299:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.765303:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765311:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765322:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.765326:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.765330:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765337:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed6f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765350:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765356:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765361:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765366:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.765369:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765375:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765381:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604464e900) 00010000:00010000:1.0:1769074935.765384:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.765386:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765391:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed6f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.765419:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed6eb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c790 expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.765429:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.765431:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.765435:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed6eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c790 expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.765443:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3a00, rc 0) 00000100:00100000:1.0:1769074935.765506:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67958:x1855007616240000:12345-192.168.204.32@tcp:101:rm.0 Request processed in 456us (678us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.765514:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9880 00000100:00100000:2.0:1769074935.802711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.802821:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240128 00000100:00100000:1.0:1769074935.802830:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240128 00000100:00100000:1.0:1769074935.802891:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9881 00000100:00100000:1.0:1769074935.802900:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67959:x1855007616240128:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.802923:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.802944:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed700 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c797 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.803024:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.803038:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803048:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803063:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.803070:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803075:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803122:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803129:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803146:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803151:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.803154:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803164:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803176:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.803179:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.803184:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803189:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed707 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803201:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803206:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803210:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803214:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.803217:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803222:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803228:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604464e900) 00010000:00010000:1.0:1769074935.803231:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.803233:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803238:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed70e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.803265:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed700 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c797 expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.803274:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.803276:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.803279:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed700 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c797 expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.803288:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3a00, rc 0) 00000100:00100000:1.0:1769074935.803350:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67959:x1855007616240128:12345-192.168.204.32@tcp:101:cp.0 Request processed in 451us (649us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.803357:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9881 00000100:00100000:2.0:1769074935.816322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.816425:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240256 00000100:00100000:1.0:1769074935.816437:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240256 00000100:00100000:1.0:1769074935.816507:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9882 00000100:00100000:1.0:1769074935.816516:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67959:x1855007616240256:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.816565:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.816599:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed715 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c79e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.816672:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.816686:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816696:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816714:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.816720:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816726:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816777:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816783:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816789:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816795:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.816799:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816806:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816817:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.816820:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.816825:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816830:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed71c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816842:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816850:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816856:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816860:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.816862:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816867:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816874:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604464e900) 00010000:00010000:1.0:1769074935.816877:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.816879:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816884:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed723 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.816913:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed715 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c79e expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.816922:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.816924:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.816927:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed715 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c79e expref: 405 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.816935:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3a00, rc 0) 00000100:00100000:1.0:1769074935.817011:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67959:x1855007616240256:12345-192.168.204.32@tcp:101:cp.0 Request processed in 496us (699us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.817019:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9882 00000100:00100000:3.0:1769074935.827776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.827880:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240512 00000100:00100000:0.0:1769074935.827890:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240512 00000100:00100000:0.0:1769074935.827960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9883 00000100:00100000:0.0:1769074935.827978:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+404:67959:x1855007616240512:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.827998:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.828018:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed72a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7a5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.828129:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.828411:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.828425:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.828441:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.828448:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.828454:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074935.828759:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xdc:0x0], index 1: 0 00010000:00010000:0.0:1769074935.828896:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed73f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.828905:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed73f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.828912:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed73f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829253:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829259:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829264:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829270:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829275:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.829280:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829287:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829299:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.829302:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.829306:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829312:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed731 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074935.829326:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e4c37cfd reply state 00000000e81104b5 transno 4294969184 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829336:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.829342:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604faeb000) 00010000:00010000:0.0:1769074935.829344:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074935.829347:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074935.829379:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eec00/0x557988ac98fed72a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7a5 expref: 407 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.829393:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee000/0x557988ac98fed73f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7a5 expref: 406 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.829400:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c1:0x0].0x0 (ffff91604faeb400) 00010000:00010000:0.0:1769074935.829403:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074935.829405:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee000, rc 0) 00000100:00100000:0.0:1769074935.829488:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67959:x1855007616240512:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1519us (1720us total) trans 4294969184 rc 0/0 00000100:00100000:0.0:1769074935.829496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9883 00000100:00100000:2.0:1769074935.837478:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074935.837632:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240640 00000100:00100000:3.0:1769074935.837643:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240640 00000100:00100000:3.0:1769074935.837705:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2873 00000100:00100000:3.0:1769074935.837715:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2418:x1855007616240640:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074935.837733:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074935.837755:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7ac expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1769074935.837781:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1769074935.837802:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.837804:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074935.837812:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.837829:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 228 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1769074935.837841:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc 0) 00000100:00100000:3.0:1769074935.837903:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2418:x1855007616240640:12345-192.168.204.32@tcp:101:cp.0 Request processed in 189us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074935.837910:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2873 00000100:00100000:2.0:1769074935.849770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.849872:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240768 00000100:00100000:0.0:1769074935.849883:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240768 00000100:00100000:0.0:1769074935.849947:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2874 00000100:00100000:0.0:1769074935.849957:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:67959:x1855007616240768:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.849984:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.850003:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7b3 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.850035:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 229 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.850043:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.850046:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.850049:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7b3 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.850092:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 229 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.850106:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 229 pid: 24564 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074935.850120:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626647680:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074935.850232:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6780 going to sleep for 11 seconds 00000100:00100000:2.0:1769074935.856335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.856698:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616240896 00000100:00100000:1.0:1769074935.856708:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616240896 00010000:00010000:1.0:1769074935.856761:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 230 pid: 24564 timeout: 2025 lvb_type: 1 00000100:00100000:1.0:1769074935.856800:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1963 00000100:00100000:1.0:1769074935.856809:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2420:x1855007616240896:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074935.856823:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074935.856844:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 230 pid: 24564 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074935.856858:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 230 pid: 24564 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074935.856882:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074935.856885:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074935.856892:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7b3 expref: 230 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.856901:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7b3 expref: 230 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.856935:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7b3 expref: 230 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074935.856948:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626647808:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074935.857046:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f900 going to sleep for 11 seconds 00010000:00010000:0.0:1769074935.859033:0:25313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f423a00/0x557988ac98fed74d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ac expref: 230 pid: 24564 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074935.859057:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626647680:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074935.859089:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f1eec00/0x557988ac98fed754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7b3 expref: 229 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.859103:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eec00, rc 0) 00000100:00100000:0.0:1769074935.859183:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:67959:x1855007616240768:12345-192.168.204.32@tcp:101:cp.0 Request processed in 9227us (9422us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.859192:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2874 00000100:00100000:1.0:1769074935.867090:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160434b2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626647808:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074935.867119:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074935.867192:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616240896:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10383us (10865us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074935.867202:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1963 00000100:00100000:1.0:1769074935.870211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.870372:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241152 00000100:00100000:2.0:1769074935.870382:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241152 00000100:00100000:2.0:1769074935.870442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1948 00000100:00100000:2.0:1769074935.870452:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+407:67959:x1855007616241152:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074935.870786:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67959:x1855007616241152:12345-192.168.204.32@tcp:35:cp.0 Request processed in 334us (582us total) trans 4294969185 rc 0/0 00000100:00100000:2.0:1769074935.870795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1948 00000100:00100000:2.0:1769074935.905049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.905172:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241280 00000100:00100000:1.0:1769074935.905184:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241280 00000100:00100000:1.0:1769074935.905247:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 308 00000100:00100000:1.0:1769074935.905257:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:2417:x1855007616241280:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074935.905295:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.905315:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed75b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7ba expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.905373:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.905389:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905399:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905413:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074935.905419:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905425:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905477:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905485:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905491:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905497:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.905501:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905508:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905520:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.905524:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.905528:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905567:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed762 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905592:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905598:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905604:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905609:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.905613:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905618:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905626:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x71251355 (ffff91604464e900) 00010000:00010000:1.0:1769074935.905629:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.905632:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905638:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed769 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x71251355 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074935.905667:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed75b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ba expref: 409 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.905677:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.905679:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074935.905682:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed75b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7ba expref: 409 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.905691:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc -2) 00000100:00100000:1.0:1769074935.905763:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:2417:x1855007616241280:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 507us (723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074935.905771:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 308 00000100:00100000:1.0:1769074935.916691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.916757:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241408 00000100:00100000:0.0:1769074935.916767:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241408 00000100:00100000:0.0:1769074935.916828:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9884 00000100:00100000:0.0:1769074935.916838:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67962:x1855007616241408:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074935.916858:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.916878:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed770 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7c1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.916944:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.916959:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.916981:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.916996:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.917003:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917009:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917062:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917069:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917074:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917080:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917085:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.917088:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917096:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917107:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.917110:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.917115:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917119:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed777 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917137:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917143:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917148:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917153:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.917156:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917162:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917170:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604faebf00) 00010000:00010000:0.0:1769074935.917172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.917174:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917179:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed77e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.917207:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed770 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7c1 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.917217:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.917219:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.917222:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed770 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7c1 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.917231:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074935.917294:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67962:x1855007616241408:12345-192.168.204.32@tcp:101:bash.0 Request processed in 458us (612us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.917302:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9884 00000100:00100000:3.0:1769074935.932042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.932165:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241536 00000100:00100000:1.0:1769074935.932175:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241536 00000100:00100000:1.0:1769074935.932238:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9885 00000100:00100000:1.0:1769074935.932248:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67963:x1855007616241536:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.932268:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.932288:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed785 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7c8 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.932355:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.932370:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932380:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932393:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.932400:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932405:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932459:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932466:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932471:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932476:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.932480:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932491:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932502:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.932505:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.932509:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932514:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed78c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932526:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932862:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932867:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932872:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.932875:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932880:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932889:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604464e900) 00010000:00010000:1.0:1769074935.932892:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.932894:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932899:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed793 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.932934:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed785 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7c8 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.932944:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.932946:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.932950:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed785 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7c8 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.932958:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074935.933035:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67963:x1855007616241536:12345-192.168.204.32@tcp:101:rm.0 Request processed in 788us (1001us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.933044:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9885 00000100:00100000:2.0:1769074935.941683:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.941785:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241664 00000100:00100000:0.0:1769074935.941796:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241664 00000100:00100000:0.0:1769074935.941861:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 309 00000100:00100000:0.0:1769074935.941872:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:2419:x1855007616241664:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074935.941907:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.941926:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed79a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7cf expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.941996:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074935.942010:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942022:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942041:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074935.942048:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942054:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942104:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942112:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942120:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942126:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.942141:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942148:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942161:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.942164:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.942169:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942175:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942188:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942194:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942201:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942206:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.942209:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942214:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942220:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x50cbaa19 (ffff91604faebf00) 00010000:00010000:0.0:1769074935.942223:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.942225:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942231:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7a8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x50cbaa19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074935.942256:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed79a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7cf expref: 409 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.942266:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.942269:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074935.942272:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed79a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7cf expref: 409 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.942281:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc -2) 00000100:00100000:0.0:1769074935.942346:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:2419:x1855007616241664:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 476us (672us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074935.942355:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 309 00000100:00100000:3.0:1769074935.949872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.950089:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241792 00000100:00100000:1.0:1769074935.950102:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241792 00000100:00100000:1.0:1769074935.950171:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9886 00000100:00100000:1.0:1769074935.950181:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67963:x1855007616241792:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074935.950200:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.950220:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7d6 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.950288:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.950304:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950314:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950332:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.950338:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950344:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950395:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950403:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950408:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950414:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.950418:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950424:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950435:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.950438:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.950442:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950447:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950458:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950465:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950471:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950475:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.950478:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950483:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950489:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604464e900) 00010000:00010000:1.0:1769074935.950491:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.950493:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950498:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.950580:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7af lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7d6 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.950590:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.950592:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.950596:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7d6 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.950606:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074935.950675:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67963:x1855007616241792:12345-192.168.204.32@tcp:101:rm.0 Request processed in 495us (814us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.950682:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9886 00000100:00100000:3.0:1769074935.969930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.970038:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616241920 00000100:00100000:0.0:1769074935.970050:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616241920 00000100:00100000:0.0:1769074935.970110:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9887 00000100:00100000:0.0:1769074935.970120:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67964:x1855007616241920:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.970149:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.970170:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed7c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7dd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.970234:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.970248:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970258:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970272:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.970278:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970283:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970334:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970341:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970347:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970353:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970358:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.970362:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970369:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970380:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.970383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.970387:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970406:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970412:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970417:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970422:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.970424:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970432:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970439:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604faebf00) 00010000:00010000:0.0:1769074935.970441:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.970443:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970448:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7d2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.970477:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed7c4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7dd expref: 409 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.970487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.970489:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.970493:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed7c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7dd expref: 409 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.970501:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074935.970609:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160437bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67964:x1855007616241920:12345-192.168.204.32@tcp:101:cp.0 Request processed in 490us (688us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074935.970617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9887 00000100:00100000:3.0:1769074935.974931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074935.975030:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242048 00000100:00100000:1.0:1769074935.975040:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242048 00000100:00100000:1.0:1769074935.975092:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9888 00000100:00100000:1.0:1769074935.975100:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67964:x1855007616242048:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074935.975119:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074935.975148:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7e4 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.975210:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.975225:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975235:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975249:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074935.975255:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975260:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975308:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975315:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975322:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975327:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.975331:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975338:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975350:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.975353:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.975358:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975363:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed7e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975374:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975380:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975386:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975391:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074935.975393:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975399:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975409:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604464e900) 00010000:00010000:1.0:1769074935.975411:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.975414:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975419:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed7e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074935.975447:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7d9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7e4 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.975456:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074935.975459:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074935.975462:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed7d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7e4 expref: 409 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074935.975471:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074935.975572:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67964:x1855007616242048:12345-192.168.204.32@tcp:101:cp.0 Request processed in 471us (650us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074935.975579:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9888 00000100:00100000:3.0:1769074935.980627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.980777:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242304 00000100:00100000:0.0:1769074935.980788:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242304 00000100:00100000:0.0:1769074935.980849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9889 00000100:00100000:0.0:1769074935.980859:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+408:67964:x1855007616242304:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.980878:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.980898:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed7ee lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.981028:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.981043:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981054:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981068:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb3321465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.981075:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981081:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:0.0:1769074935.981645:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xdc:0x0], index 0: 0 00010000:00010000:0.0:1769074935.981803:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed803 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074935.981812:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed803 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981819:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed803 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981853:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981859:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981866:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981871:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981876:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074935.981880:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981887:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981898:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074935.981902:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074935.981906:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981911:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed7f5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1769074935.981925:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000667572 reply state 000000003d616b48 transno 4294969186 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981935:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074935.981941:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604faebf00) 00010000:00010000:0.0:1769074935.981943:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074935.981945:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074935.981986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee400/0x557988ac98fed7ee lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7eb expref: 411 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.982004:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee200/0x557988ac98fed803 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7eb expref: 410 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.982011:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c2:0x0].0x0 (ffff91604faebb00) 00010000:00010000:0.0:1769074935.982013:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074935.982015:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee200, rc 0) 00000100:00100000:0.0:1769074935.982091:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67964:x1855007616242304:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1233us (1473us total) trans 4294969186 rc 0/0 00000100:00100000:0.0:1769074935.982099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9889 00000100:00100000:3.0:1769074935.986895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.987018:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242432 00000100:00100000:0.0:1769074935.987029:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242432 00000100:00100000:0.0:1769074935.987085:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2875 00000100:00100000:0.0:1769074935.987095:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616242432:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.987113:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.987147:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7f2 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074935.987171:0:25313:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074935.987189:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.987192:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.987200:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 230 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.987216:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 230 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.987234:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc 0) 00000100:00100000:0.0:1769074935.987288:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2418:x1855007616242432:12345-192.168.204.32@tcp:101:cp.0 Request processed in 195us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.987296:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2875 00010000:00010000:0.0:1769074935.988871:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074935.991287:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074935.991453:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242560 00000100:00100000:0.0:1769074935.991464:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242560 00000100:00100000:0.0:1769074935.991525:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2876 00000100:00100000:0.0:1769074935.991568:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:67964:x1855007616242560:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074935.991594:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074935.991612:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c7f9 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.991642:0:24564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 231 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.991650:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.991652:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074935.991656:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f9 expref: 231 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.991690:0:24564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 231 pid: 25313 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074935.991704:0:24564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 231 pid: 25313 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074935.991725:0:24564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626647936:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074935.991820:0:24564:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1769074935.995398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074935.995513:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242688 00000100:00100000:2.0:1769074935.995524:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242688 00010000:00010000:2.0:1769074935.995620:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 232 pid: 25313 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074935.995663:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1964 00000100:00100000:2.0:1769074935.995674:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2419:x1855007616242688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074935.995691:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074935.995717:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 232 pid: 25313 timeout: 2025 lvb_type: 1 00010000:00010000:2.0:1769074935.995731:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 232 pid: 25313 timeout: 2025 lvb_type: 1 00010000:00010000:2.0:1769074935.995760:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.995762:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074935.995770:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f9 expref: 232 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.995779:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f9 expref: 232 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074935.995818:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f9 expref: 232 pid: 24564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074935.995831:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626648064:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074935.995909:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315a80 going to sleep for 11 seconds 00010000:00010000:0.0:1769074935.996719:0:24564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f1eee00/0x557988ac98fed811 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f2 expref: 232 pid: 25313 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074935.996737:0:24564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916049c46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:24564:1855007626647936:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074935.996762:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f1ee400/0x557988ac98fed818 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c7f9 expref: 231 pid: 24564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074935.996772:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ee400, rc 0) 00000100:00100000:0.0:1769074935.996822:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+231:67964:x1855007616242560:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5256us (5544us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074935.996830:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2876 00000100:00100000:1.0:1769074936.002268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.002367:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626648064:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074936.002393:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074936.002454:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2419:x1855007616242688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6780us (7065us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.002466:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1964 00000100:00100000:3.0:1769074936.002574:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616242944 00000100:00100000:3.0:1769074936.002591:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616242944 00000100:00100000:3.0:1769074936.002639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1949 00000100:00100000:3.0:1769074936.002648:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+411:67964:x1855007616242944:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074936.002915:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67964:x1855007616242944:12345-192.168.204.32@tcp:35:cp.0 Request processed in 268us (656us total) trans 4294969187 rc 0/0 00000100:00100000:3.0:1769074936.002921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1949 00000100:00100000:1.0:1769074936.029454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.029648:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243200 00000100:00100000:1.0:1769074936.029658:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243200 00002000:00100000:1.0:1769074936.029703:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6a:0x0] (0->157) req@ffff9160434b0000 x1855007616243200/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029715:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0000 with x1855007616243200 ext(0->157) 00002000:00010000:1.0:1769074936.029721:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0000 00000100:00100000:1.0:1769074936.029738:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243456 00000100:00100000:1.0:1769074936.029741:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243456 00002000:00100000:1.0:1769074936.029750:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6b:0x0] (0->157) req@ffff9161485f3100 x1855007616243456/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029758:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3100 with x1855007616243456 ext(0->157) 00002000:00010000:1.0:1769074936.029762:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f3100 00000100:00100000:1.0:1769074936.029770:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243712 00000100:00100000:1.0:1769074936.029772:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243712 00002000:00100000:1.0:1769074936.029781:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6c:0x0] (0->157) req@ffff9161485f2d80 x1855007616243712/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029789:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2d80 with x1855007616243712 ext(0->157) 00002000:00010000:1.0:1769074936.029792:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f2d80 00000100:00100000:1.0:1769074936.029797:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243968 00000100:00100000:1.0:1769074936.029798:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243968 00002000:00100000:1.0:1769074936.029807:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6d:0x0] (0->157) req@ffff9161815f5c00 x1855007616243968/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029814:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5c00 with x1855007616243968 ext(0->157) 00002000:00010000:1.0:1769074936.029818:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5c00 00000100:00100000:1.0:1769074936.029822:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244224 00000100:00100000:1.0:1769074936.029824:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244224 00002000:00100000:1.0:1769074936.029832:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6e:0x0] (0->157) req@ffff9161815f5500 x1855007616244224/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029840:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5500 with x1855007616244224 ext(0->157) 00002000:00010000:1.0:1769074936.029843:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5500 00000100:00100000:1.0:1769074936.029849:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244480 00000100:00100000:1.0:1769074936.029851:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244480 00002000:00100000:1.0:1769074936.029862:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6f:0x0] (0->157) req@ffff9161815f6a00 x1855007616244480/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.029868:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6a00 with x1855007616244480 ext(0->157) 00002000:00010000:1.0:1769074936.029871:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f6a00 00000100:00100000:1.0:1769074936.029882:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 694 00000100:00100000:1.0:1769074936.029890:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2420:x1855007616243200:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.030345:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 695 00000100:00100000:0.0:1769074936.030356:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2420:x1855007616243456:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.030730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.030819:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244736 00000100:00100000:0.0:1769074936.030823:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244736 00002000:00100000:0.0:1769074936.030848:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x70:0x0] (0->157) req@ffff916049c46300 x1855007616244736/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.030857:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c46300 with x1855007616244736 ext(0->157) 00002000:00010000:0.0:1769074936.030863:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c46300 00000100:00100000:0.0:1769074936.030872:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244992 00000100:00100000:0.0:1769074936.030875:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244992 00002000:00100000:0.0:1769074936.030887:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x71:0x0] (0->157) req@ffff916049c45f80 x1855007616244992/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.030895:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c45f80 with x1855007616244992 ext(0->157) 00002000:00010000:0.0:1769074936.030899:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c45f80 00000100:00100000:0.0:1769074936.030905:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245248 00000100:00100000:0.0:1769074936.030907:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245248 00002000:00100000:0.0:1769074936.030918:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x72:0x0] (0->157) req@ffff916049c46a00 x1855007616245248/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.030925:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c46a00 with x1855007616245248 ext(0->157) 00002000:00010000:0.0:1769074936.030928:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c46a00 00000100:00100000:0.0:1769074936.030934:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243072 00000100:00100000:0.0:1769074936.030936:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243072 00002000:00100000:0.0:1769074936.030950:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x69:0x0] (0->157) req@ffff916049c44e00 x1855007616243072/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.030957:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c44e00 with x1855007616243072 ext(0->157) 00002000:00010000:0.0:1769074936.030960:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049c44e00 00000100:00100000:0.0:1769074936.030978:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243328 00000100:00100000:0.0:1769074936.030981:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243328 00002000:00100000:0.0:1769074936.030995:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6a:0x0] (0->157) req@ffff916049c47b80 x1855007616243328/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.031010:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c47b80 with x1855007616243328 ext(0->157) 00002000:00010000:0.0:1769074936.031013:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049c47b80 00000100:00100000:0.0:1769074936.031019:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243584 00000100:00100000:0.0:1769074936.031021:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243584 00002000:00100000:0.0:1769074936.031032:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6b:0x0] (0->157) req@ffff91604ac92a00 x1855007616243584/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.031040:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92a00 with x1855007616243584 ext(0->157) 00002000:00010000:0.0:1769074936.031043:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92a00 00000100:00100000:0.0:1769074936.031051:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 696 00000100:00100000:0.0:1769074936.031057:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616243712:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.031564:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 697 00000100:00100000:2.0:1769074936.031589:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2420:x1855007616243968:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.031793:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 698 00000100:00100000:2.0:1769074936.031801:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616244224:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.031983:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 699 00000100:00100000:2.0:1769074936.031992:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2420:x1855007616244480:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.033937:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616243968:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2354us (4346us total) trans 4294967878 rc 0/0 00000100:00100000:2.0:1769074936.033950:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 697 00002000:00100000:2.0:1769074936.033962:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x6d:0x0] (0->157) req@ffff9161815f5c00 x1855007616243968/t4294967878(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.033989:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5c00 with x1855007616243968 ext(0->157) 00002000:00010000:2.0:1769074936.033995:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5c00 00000100:00100000:2.0:1769074936.034026:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 700 00000100:00100000:2.0:1769074936.034037:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616244736:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074936.035017:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616244480:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3020us (5384us total) trans 4294967880 rc 0/0 00000100:00100000:3.0:1769074936.035028:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 699 00002000:00100000:3.0:1769074936.035036:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x6f:0x0] (0->157) req@ffff9161815f6a00 x1855007616244480/t4294967880(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.035044:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6a00 with x1855007616244480 ext(0->157) 00002000:00010000:3.0:1769074936.035049:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f6a00 00000100:00100000:3.0:1769074936.035070:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 701 00000100:00100000:3.0:1769074936.035080:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2420:x1855007616244992:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074936.035563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.035602:0:20239:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.035610:0:20239:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000100:00100000:3.0:1769074936.035668:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.035682:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.035689:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616243840 00000100:00100000:3.0:1769074936.035696:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616243840 00002000:00100000:3.0:1769074936.035726:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6c:0x0] (0->157) req@ffff9160434ac000 x1855007616243840/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.035736:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac000 with x1855007616243840 ext(0->157) 00002000:00010000:3.0:1769074936.035740:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac000 00000100:00100000:3.0:1769074936.035750:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.035755:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244096 00000100:00100000:3.0:1769074936.035757:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244096 00002000:00100000:3.0:1769074936.035767:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6d:0x0] (0->157) req@ffff9160434afb80 x1855007616244096/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.035775:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434afb80 with x1855007616244096 ext(0->157) 00002000:00010000:3.0:1769074936.035780:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434afb80 00000100:00100000:3.0:1769074936.035830:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.035842:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.035847:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244352 00000100:00100000:3.0:1769074936.035850:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244352 00002000:00100000:3.0:1769074936.035865:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6e:0x0] (0->157) req@ffff9160434ad180 x1855007616244352/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.035872:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ad180 with x1855007616244352 ext(0->157) 00002000:00010000:3.0:1769074936.035876:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ad180 00000100:00100000:3.0:1769074936.035900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.035913:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.035928:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244608 00000100:00100000:3.0:1769074936.035931:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244608 00002000:00100000:3.0:1769074936.035946:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6f:0x0] (0->157) req@ffff9160434ac380 x1855007616244608/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.035955:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac380 with x1855007616244608 ext(0->157) 00002000:00010000:3.0:1769074936.035958:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac380 00000100:00100000:3.0:1769074936.035998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.036011:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.036016:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616244864 00000100:00100000:3.0:1769074936.036018:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616244864 00002000:00100000:3.0:1769074936.036033:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x70:0x0] (0->157) req@ffff9160434af800 x1855007616244864/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.036040:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af800 with x1855007616244864 ext(0->157) 00002000:00010000:3.0:1769074936.036043:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434af800 00000100:00100000:3.0:1769074936.036069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.036080:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1769074936.036085:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245120 00000100:00100000:3.0:1769074936.036088:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245120 00002000:00100000:3.0:1769074936.036101:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x71:0x0] (0->157) req@ffff9160434ac700 x1855007616245120/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.036108:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac700 with x1855007616245120 ext(0->157) 00002000:00010000:3.0:1769074936.036112:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac700 00000100:00100000:0.0:1769074936.037104:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616244224:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5296us (7484us total) trans 4294967879 rc 0/0 00000100:00100000:0.0:1769074936.037115:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 698 00002000:00100000:0.0:1769074936.037123:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x6e:0x0] (0->157) req@ffff9161815f5500 x1855007616244224/t4294967879(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.037144:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5500 with x1855007616244224 ext(0->157) 00002000:00010000:0.0:1769074936.037149:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5500 00000100:00100000:0.0:1769074936.037173:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 702 00000100:00100000:0.0:1769074936.037182:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616245248:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.037596:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616243712:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6536us (8067us total) trans 4294967877 rc 0/0 00000100:00100000:0.0:1769074936.037604:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 696 00002000:00100000:0.0:1769074936.037610:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x6c:0x0] (0->157) req@ffff9161485f2d80 x1855007616243712/t4294967877(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.037618:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f2d80 with x1855007616243712 ext(0->157) 00002000:00010000:0.0:1769074936.037622:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f2d80 00000100:00100000:0.0:1769074936.037638:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 703 00000100:00100000:0.0:1769074936.037645:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616243072:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074936.042110:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161485f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616243456:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11745us (12601us total) trans 4294967876 rc 0/0 00000100:00100000:3.0:1769074936.042124:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 695 00002000:00100000:3.0:1769074936.042144:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x6b:0x0] (0->157) req@ffff9161485f3100 x1855007616243456/t4294967876(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.042155:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161485f3100 with x1855007616243456 ext(0->157) 00002000:00010000:3.0:1769074936.042160:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161485f3100 00000100:00100000:3.0:1769074936.042194:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 704 00000100:00100000:3.0:1769074936.042206:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2420:x1855007616243328:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.047105:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616245248:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9913us (16332us total) trans 4294967882 rc 0/0 00000100:00100000:1.0:1769074936.047120:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 702 00002000:00100000:1.0:1769074936.047132:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x72:0x0] (0->157) req@ffff916049c46a00 x1855007616245248/t4294967882(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.047143:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c46a00 with x1855007616245248 ext(0->157) 00000100:00100000:3.0:1769074936.047146:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 705 00002000:00010000:1.0:1769074936.047148:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c46a00 00000100:00100000:3.0:1769074936.047158:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616243584:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.047211:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616244992:12345-192.168.204.32@tcp:4:cp.0 Request processed in 12134us (16462us total) trans 4294967881 rc 0/0 00000100:00100000:1.0:1769074936.047217:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 701 00002000:00100000:1.0:1769074936.047223:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x71:0x0] (0->157) req@ffff916049c45f80 x1855007616244992/t4294967881(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.047231:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c45f80 with x1855007616244992 ext(0->157) 00002000:00010000:1.0:1769074936.047234:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c45f80 00000100:00100000:1.0:1769074936.047249:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 706 00000100:00100000:1.0:1769074936.047256:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616243840:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.047690:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616243072:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10043us (16916us total) trans 4294967864 rc 0/0 00000100:00100000:1.0:1769074936.047697:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 703 00002000:00100000:1.0:1769074936.047703:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x69:0x0] (0->157) req@ffff916049c44e00 x1855007616243072/t4294967864(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.047711:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c44e00 with x1855007616243072 ext(0->157) 00002000:00010000:1.0:1769074936.047715:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049c44e00 00000100:00100000:1.0:1769074936.047728:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 707 00000100:00100000:1.0:1769074936.047734:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616244096:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.051566:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616243840:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4300us (16024us total) trans 4294967867 rc 0/0 00000100:00100000:1.0:1769074936.051581:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 706 00002000:00100000:1.0:1769074936.051593:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6c:0x0] (0->157) req@ffff9160434ac000 x1855007616243840/t4294967867(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.051603:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac000 with x1855007616243840 ext(0->157) 00002000:00010000:1.0:1769074936.051608:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac000 00000100:00100000:1.0:1769074936.051636:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 708 00000100:00100000:1.0:1769074936.051646:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616244352:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.052015:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616244096:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4280us (16346us total) trans 4294967868 rc 0/0 00000100:00100000:1.0:1769074936.052025:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 707 00002000:00100000:1.0:1769074936.052033:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6d:0x0] (0->157) req@ffff9160434afb80 x1855007616244096/t4294967868(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.052041:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434afb80 with x1855007616244096 ext(0->157) 00002000:00010000:1.0:1769074936.052045:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434afb80 00000100:00100000:1.0:1769074936.052062:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 709 00000100:00100000:1.0:1769074936.052069:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616244608:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.052290:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616243200:12345-192.168.204.32@tcp:4:cp.0 Request processed in 22399us (22844us total) trans 4294967883 rc 0/0 00000100:00100000:0.0:1769074936.052298:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 694 00002000:00100000:0.0:1769074936.052304:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x6a:0x0] (0->157) req@ffff9160434b0000 x1855007616243200/t4294967883(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.052333:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0000 with x1855007616243200 ext(0->157) 00002000:00010000:0.0:1769074936.052337:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0000 00000100:00100000:0.0:1769074936.052358:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 710 00000100:00100000:0.0:1769074936.052366:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616244864:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.055474:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+249:2420:x1855007616244864:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3097us (19463us total) trans 4294967870 rc 0/0 00000100:00100000:0.0:1769074936.055487:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 710 00002000:00100000:0.0:1769074936.055510:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x70:0x0] (0->157) req@ffff9160434af800 x1855007616244864/t4294967870(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.055520:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af800 with x1855007616244864 ext(0->157) 00002000:00010000:0.0:1769074936.055526:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434af800 00000100:00100000:0.0:1769074936.055582:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 711 00000100:00100000:0.0:1769074936.055594:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616245120:12345-192.168.204.32@tcp:4:cp.0 00000001:00080000:0.0:1769074936.058656:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967864 is committed 00000001:00080000:0.0:1769074936.058670:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967863 is committed 00000100:00100000:0.0:1769074936.059649:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616245120:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4051us (23570us total) trans 4294967871 rc 0/0 00000100:00100000:0.0:1769074936.059661:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 711 00002000:00100000:0.0:1769074936.059674:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x71:0x0] (0->157) req@ffff9160434ac700 x1855007616245120/t4294967871(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.059684:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac700 with x1855007616245120 ext(0->157) 00002000:00010000:0.0:1769074936.059691:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac700 00000100:00100000:2.0:1769074936.061789:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616244736:12345-192.168.204.32@tcp:4:cp.0 Request processed in 27747us (31052us total) trans 4294967884 rc 0/0 00000100:00100000:2.0:1769074936.061803:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 700 00002000:00100000:2.0:1769074936.061814:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x70:0x0] (0->157) req@ffff916049c46300 x1855007616244736/t4294967884(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.061927:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c46300 with x1855007616244736 ext(0->157) 00002000:00010000:2.0:1769074936.061933:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049c46300 00000100:00100000:2.0:1769074936.063142:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616244608:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11066us (27234us total) trans 4294967872 rc 0/0 00000100:00100000:2.0:1769074936.063153:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 709 00002000:00100000:2.0:1769074936.063163:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6f:0x0] (0->157) req@ffff9160434ac380 x1855007616244608/t4294967872(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.063172:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ac380 with x1855007616244608 ext(0->157) 00002000:00010000:2.0:1769074936.063178:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ac380 00000100:00100000:0.0:1769074936.064647:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616244352:12345-192.168.204.32@tcp:4:cp.0 Request processed in 12996us (28810us total) trans 4294967869 rc 0/0 00000100:00100000:0.0:1769074936.064659:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 708 00002000:00100000:0.0:1769074936.064670:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x6e:0x0] (0->157) req@ffff9160434ad180 x1855007616244352/t4294967869(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.064678:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ad180 with x1855007616244352 ext(0->157) 00002000:00010000:0.0:1769074936.064684:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ad180 00000001:00080000:2.0:1769074936.067485:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967880 is committed 00000001:00080000:2.0:1769074936.067523:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967875 is committed 00000100:00100000:1.0:1769074936.077668:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616243584:12345-192.168.204.32@tcp:4:cp.0 Request processed in 30503us (46863us total) trans 4294967866 rc 0/0 00000100:00100000:1.0:1769074936.077684:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 705 00002000:00100000:1.0:1769074936.077699:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6b:0x0] (0->157) req@ffff91604ac92a00 x1855007616243584/t4294967866(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.077708:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92a00 with x1855007616243584 ext(0->157) 00002000:00010000:1.0:1769074936.077714:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92a00 00000100:00100000:1.0:1769074936.077808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.077834:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245504 00000100:00100000:1.0:1769074936.077842:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245504 00002000:00100000:1.0:1769074936.077877:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x75:0x0] (0->157) req@ffff9161815f5880 x1855007616245504/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.077884:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5880 with x1855007616245504 ext(0->157) 00002000:00010000:1.0:1769074936.077887:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5880 00000100:00100000:1.0:1769074936.077904:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 712 00000100:00100000:1.0:1769074936.077912:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2420:x1855007616245504:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074936.077924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.077945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.077961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.077994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.078011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.078027:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.078043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.078317:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245376 00000100:00100000:1.0:1769074936.078321:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245376 00002000:00100000:1.0:1769074936.078339:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x77:0x0] (0->157) req@ffff9160434aed80 x1855007616245376/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078348:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434aed80 with x1855007616245376 ext(0->157) 00002000:00010000:1.0:1769074936.078353:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434aed80 00000100:00100000:1.0:1769074936.078362:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245632 00000100:00100000:1.0:1769074936.078365:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245632 00002000:00100000:1.0:1769074936.078378:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x76:0x0] (0->157) req@ffff9160434ad880 x1855007616245632/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078385:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ad880 with x1855007616245632 ext(0->157) 00002000:00010000:1.0:1769074936.078388:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ad880 00000100:00100000:1.0:1769074936.078394:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245888 00000100:00100000:1.0:1769074936.078396:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245888 00002000:00100000:1.0:1769074936.078406:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x79:0x0] (0->157) req@ffff9160434af100 x1855007616245888/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078412:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af100 with x1855007616245888 ext(0->157) 00002000:00010000:1.0:1769074936.078414:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434af100 00000100:00100000:1.0:1769074936.078419:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246144 00000100:00100000:1.0:1769074936.078421:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246144 00002000:00100000:1.0:1769074936.078432:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x7a:0x0] (0->157) req@ffff916149867b80 x1855007616246144/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078439:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149867b80 with x1855007616246144 ext(0->157) 00002000:00010000:1.0:1769074936.078443:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149867b80 00000100:00100000:1.0:1769074936.078449:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616245760 00000100:00100000:1.0:1769074936.078452:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616245760 00002000:00100000:1.0:1769074936.078498:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x74:0x0] (0->157) req@ffff916149864700 x1855007616245760/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078505:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149864700 with x1855007616245760 ext(0->157) 00002000:00010000:1.0:1769074936.078508:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149864700 00000100:00100000:1.0:1769074936.078516:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246016 00000100:00100000:1.0:1769074936.078519:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246016 00002000:00100000:1.0:1769074936.078552:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x76:0x0] (0->157) req@ffff916149867800 x1855007616246016/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078560:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149867800 with x1855007616246016 ext(0->157) 00002000:00010000:1.0:1769074936.078563:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149867800 00000100:00100000:3.0:1769074936.078563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.078570:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246272 00000100:00100000:1.0:1769074936.078573:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246272 00002000:00100000:1.0:1769074936.078586:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x73:0x0] (0->157) req@ffff916149864a80 x1855007616246272/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078593:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149864a80 with x1855007616246272 ext(0->157) 00000100:00100000:3.0:1769074936.078593:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 713 00002000:00010000:1.0:1769074936.078596:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149864a80 00000100:00100000:3.0:1769074936.078602:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616245376:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.078604:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 714 00000100:00100000:1.0:1769074936.078608:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616245632:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.078841:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2420:x1855007616245504:12345-192.168.204.32@tcp:4:cp.0 Request processed in 928us (1031us total) trans 4294967885 rc 0/0 00000100:00100000:1.0:1769074936.078849:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 712 00002000:00100000:1.0:1769074936.078855:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x75:0x0] (0->157) req@ffff9161815f5880 x1855007616245504/t4294967885(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.078862:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5880 with x1855007616245504 ext(0->157) 00002000:00010000:1.0:1769074936.078866:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f5880 00000100:00100000:1.0:1769074936.078882:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 715 00000100:00100000:1.0:1769074936.078889:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2419:x1855007616245888:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.079099:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616245632:12345-192.168.204.32@tcp:4:cp.0 Request processed in 488us (1151us total) trans 4294967873 rc 0/0 00000100:00100000:1.0:1769074936.079106:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 714 00002000:00100000:1.0:1769074936.079112:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x76:0x0] (0->157) req@ffff9160434ad880 x1855007616245632/t4294967873(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.079120:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434ad880 with x1855007616245632 ext(0->157) 00002000:00010000:1.0:1769074936.079123:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434ad880 00000100:00100000:1.0:1769074936.079137:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 716 00000100:00100000:1.0:1769074936.079143:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616246144:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074936.079266:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616245376:12345-192.168.204.32@tcp:4:cp.0 Request processed in 665us (1341us total) trans 4294967887 rc 0/0 00000100:00100000:3.0:1769074936.079274:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 713 00002000:00100000:3.0:1769074936.079280:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x77:0x0] (0->157) req@ffff9160434aed80 x1855007616245376/t4294967887(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.079287:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434aed80 with x1855007616245376 ext(0->157) 00002000:00010000:3.0:1769074936.079291:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434aed80 00000100:00100000:3.0:1769074936.079304:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 717 00000100:00100000:3.0:1769074936.079311:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616245760:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.079331:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616245888:12345-192.168.204.32@tcp:4:cp.0 Request processed in 442us (1367us total) trans 4294967886 rc 0/0 00000100:00100000:1.0:1769074936.079337:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 715 00002000:00100000:1.0:1769074936.079343:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x79:0x0] (0->157) req@ffff9160434af100 x1855007616245888/t4294967886(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.079351:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af100 with x1855007616245888 ext(0->157) 00002000:00010000:1.0:1769074936.079354:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434af100 00000100:00100000:1.0:1769074936.079366:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 718 00000100:00100000:1.0:1769074936.079373:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616246016:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.079671:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616246144:12345-192.168.204.32@tcp:4:cp.0 Request processed in 526us (1674us total) trans 4294967888 rc 0/0 00000100:00100000:1.0:1769074936.079677:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 716 00002000:00100000:1.0:1769074936.079683:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x7a:0x0] (0->157) req@ffff916149867b80 x1855007616246144/t4294967888(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.079690:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149867b80 with x1855007616246144 ext(0->157) 00002000:00010000:1.0:1769074936.079694:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149867b80 00000100:00100000:1.0:1769074936.079707:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 719 00000100:00100000:1.0:1769074936.079714:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616246272:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.079883:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616246016:12345-192.168.204.32@tcp:4:cp.0 Request processed in 509us (1853us total) trans 4294967889 rc 0/0 00000100:00100000:1.0:1769074936.079889:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 718 00002000:00100000:1.0:1769074936.079895:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x76:0x0] (0->157) req@ffff916149867800 x1855007616246016/t4294967889(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.079903:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149867800 with x1855007616246016 ext(0->157) 00002000:00010000:1.0:1769074936.079906:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149867800 00000100:00100000:1.0:1769074936.080021:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246400 00000100:00100000:1.0:1769074936.080027:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246400 00000100:00100000:1.0:1769074936.080058:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9890 00000100:00100000:1.0:1769074936.080065:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67967:x1855007616246400:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074936.080076:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.080096:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed81f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c800 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074936.080104:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616246272:12345-192.168.204.32@tcp:4:cp.0 Request processed in 391us (2059us total) trans 4294967890 rc 0/0 00000100:00100000:2.0:1769074936.080112:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 719 00002000:00100000:2.0:1769074936.080117:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x73:0x0] (0->157) req@ffff916149864a80 x1855007616246272/t4294967890(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.080136:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149864a80 with x1855007616246272 ext(0->157) 00002000:00010000:2.0:1769074936.080140:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149864a80 00010000:00010000:1.0:1769074936.080154:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.080170:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080184:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080199:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.080206:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080212:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080262:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080269:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080274:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080280:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080286:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.080290:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080296:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080307:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.080310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.080315:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed826 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080331:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080337:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080343:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080347:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.080350:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080355:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080362:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604464e600) 00010000:00010000:1.0:1769074936.080365:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.080368:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080373:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98fed82d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.080402:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed81f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c800 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.080411:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.080414:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.080418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed81f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c800 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.080426:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2000, rc 0) 00000100:00100000:1.0:1769074936.080446:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67967:x1855007616246400:12345-192.168.204.32@tcp:101:bash.0 Request processed in 382us (1883us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.080453:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9890 00000100:00100000:3.0:1769074936.080649:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616245760:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1337us (2634us total) trans 4294967891 rc 0/0 00000100:00100000:3.0:1769074936.080657:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 717 00002000:00100000:3.0:1769074936.080662:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x74:0x0] (0->157) req@ffff916149864700 x1855007616245760/t4294967891(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.080669:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916149864700 with x1855007616245760 ext(0->157) 00002000:00010000:3.0:1769074936.080673:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916149864700 00000100:00100000:0.0:1769074936.081071:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616243328:12345-192.168.204.32@tcp:4:cp.0 Request processed in 38868us (50286us total) trans 4294967865 rc 0/0 00000100:00100000:0.0:1769074936.081078:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 704 00002000:00100000:0.0:1769074936.081084:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x6a:0x0] (0->157) req@ffff916049c47b80 x1855007616243328/t4294967865(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.081092:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049c47b80 with x1855007616243328 ext(0->157) 00002000:00010000:0.0:1769074936.081095:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049c47b80 00000100:00100000:1.0:1769074936.088173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.088245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.090297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.090448:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246528 00000100:00100000:0.0:1769074936.090460:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246528 00002000:00100000:0.0:1769074936.090528:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x78:0x0] (0->157) req@ffff9161815f7480 x1855007616246528/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.090555:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f7480 with x1855007616246528 ext(0->157) 00002000:00010000:0.0:1769074936.090560:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f7480 00000100:00100000:3.0:1769074936.090614:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246784 00000100:00100000:3.0:1769074936.090620:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246784 00002000:00100000:3.0:1769074936.090641:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x73:0x0] (0->157) req@ffff9161815f4e00 x1855007616246784/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.090650:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4e00 with x1855007616246784 ext(0->157) 00002000:00010000:3.0:1769074936.090653:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4e00 00000100:00100000:3.0:1769074936.090680:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 720 00000100:00100000:3.0:1769074936.090689:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616246528:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.091385:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 721 00000100:00100000:2.0:1769074936.091396:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2419:x1855007616246784:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.092014:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2419:x1855007616246784:12345-192.168.204.32@tcp:4:cp.0 Request processed in 617us (3763us total) trans 4294967874 rc 0/0 00000100:00100000:2.0:1769074936.092026:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 721 00002000:00100000:2.0:1769074936.092035:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x73:0x0] (0->157) req@ffff9161815f4e00 x1855007616246784/t4294967874(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.092043:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4e00 with x1855007616246784 ext(0->157) 00002000:00010000:2.0:1769074936.092049:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4e00 00000100:00100000:3.0:1769074936.092667:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2419:x1855007616246528:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1975us (4499us total) trans 4294967892 rc 0/0 00000100:00100000:3.0:1769074936.092676:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 720 00002000:00100000:3.0:1769074936.092683:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x78:0x0] (0->157) req@ffff9161815f7480 x1855007616246528/t4294967892(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.092691:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f7480 with x1855007616246528 ext(0->157) 00002000:00010000:3.0:1769074936.092695:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815f7480 00000100:00100000:1.0:1769074936.094346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.094365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.094384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.094412:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247040 00000100:00100000:1.0:1769074936.094421:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247040 00002000:00100000:1.0:1769074936.094464:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x75:0x0] (0->157) req@ffff9161815f6300 x1855007616247040/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.094474:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6300 with x1855007616247040 ext(0->157) 00002000:00010000:1.0:1769074936.094479:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6300 00000100:00100000:1.0:1769074936.094600:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247296 00000100:00100000:1.0:1769074936.094604:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247296 00002000:00100000:1.0:1769074936.094622:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x72:0x0] (0->157) req@ffff9161815f5180 x1855007616247296/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.094630:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5180 with x1855007616247296 ext(0->157) 00002000:00010000:1.0:1769074936.094634:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f5180 00000100:00100000:1.0:1769074936.094648:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246656 00000100:00100000:1.0:1769074936.094651:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246656 00002000:00100000:1.0:1769074936.094670:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x77:0x0] (0->157) req@ffff9161815f4a80 x1855007616246656/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.094678:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4a80 with x1855007616246656 ext(0->157) 00002000:00010000:1.0:1769074936.094682:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4a80 00000100:00100000:1.0:1769074936.094697:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616246912 00000100:00100000:1.0:1769074936.094700:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616246912 00002000:00100000:1.0:1769074936.094713:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x78:0x0] (0->157) req@ffff9161815f6680 x1855007616246912/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.094720:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6680 with x1855007616246912 ext(0->157) 00002000:00010000:1.0:1769074936.094724:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6680 00000100:00100000:1.0:1769074936.094740:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 722 00000100:00100000:1.0:1769074936.094748:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616247040:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074936.095158:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 723 00000100:00100000:1.0:1769074936.095165:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616247296:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.095276:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 724 00000100:00100000:0.0:1769074936.095287:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616246656:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074936.096065:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 725 00000100:00100000:2.0:1769074936.096079:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616246912:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.096895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.096918:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247168 00000100:00100000:0.0:1769074936.096924:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247168 00002000:00100000:0.0:1769074936.096956:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x79:0x0] (0->157) req@ffff91604ac90000 x1855007616247168/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074936.096976:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90000 with x1855007616247168 ext(0->157) 00002000:00010000:0.0:1769074936.096982:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90000 00000100:00100000:0.0:1769074936.096999:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 726 00000100:00100000:0.0:1769074936.097007:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2419:x1855007616247168:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074936.097221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.097236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.097263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.097280:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247680 00000100:00100000:0.0:1769074936.097283:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247680 00000100:00100000:0.0:1769074936.097306:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 310 00000100:00100000:0.0:1769074936.097311:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:2419:x1855007616247680:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074936.097351:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.097369:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed834 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c80e expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.097416:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074936.097430:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.097441:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.097455:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074936.097462:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.097467:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00000100:00100000:3.0:1769074936.097855:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247424 00000100:00100000:3.0:1769074936.097861:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247424 00002000:00100000:3.0:1769074936.097888:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x74:0x0] (0->157) req@ffff91604ac91c00 x1855007616247424/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/0 e 0 to 0 dl 1769074947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.097897:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91c00 with x1855007616247424 ext(0->157) 00002000:00010000:3.0:1769074936.097901:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac91c00 00000100:00100000:3.0:1769074936.097913:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 727 00000100:00100000:3.0:1769074936.097920:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2419:x1855007616247424:12345-192.168.204.32@tcp:4:cp.0 00010000:00010000:0.0:1769074936.098329:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00000100:00100000:3.0:1769074936.098420:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247552 00000100:00100000:3.0:1769074936.098425:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247552 00000100:00100000:3.0:1769074936.098458:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9891 00000100:00100000:3.0:1769074936.098465:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+414:67968:x1855007616247552:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074936.098474:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.098488:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed849 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c807 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.099019:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099026:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099032:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.099036:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099043:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099061:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.099064:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.099068:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099074:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fed83b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099089:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099094:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099099:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099103:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.099106:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099112:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099117:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87c92ea6 (ffff91604f1ad000) 00010000:00010000:0.0:1769074936.099120:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.099123:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099128:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fed842 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074936.099160:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed834 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c80e expref: 414 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.099171:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.099173:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074936.099177:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed834 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c80e expref: 414 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.099185:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef600, rc -2) 00000100:00100000:0.0:1769074936.099253:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+413:2419:x1855007616247680:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1940us (1988us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074936.099260:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 310 00010000:00010000:3.0:1769074936.099460:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074936.099473:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099482:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099702:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074936.099710:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099717:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099757:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099763:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099768:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099774:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.099777:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099782:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099789:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.099792:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.099794:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099799:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed850 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099808:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099813:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099818:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099822:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.099824:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099829:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099834:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604e58c100) 00010000:00010000:3.0:1769074936.099837:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.099839:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099844:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed857 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.099865:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed849 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c807 expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.099872:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.099875:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.099878:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed849 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c807 expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.099886:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422c00, rc 0) 00000100:00100000:3.0:1769074936.099919:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67968:x1855007616247552:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1455us (2682us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074936.099926:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9891 00000100:00100000:2.0:1769074936.100235:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2419:x1855007616246656:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4948us (5865us total) trans 4294967876 rc 0/0 00000100:00100000:2.0:1769074936.100244:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 724 00002000:00100000:2.0:1769074936.100254:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x77:0x0] (0->157) req@ffff9161815f4a80 x1855007616246656/t4294967876(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.100264:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4a80 with x1855007616246656 ext(0->157) 00002000:00010000:2.0:1769074936.100269:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4a80 00000100:00100000:3.0:1769074936.100883:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2419:x1855007616247424:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2962us (3659us total) trans 4294967879 rc 0/0 00000100:00100000:3.0:1769074936.100891:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 727 00002000:00100000:3.0:1769074936.100898:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x74:0x0] (0->157) req@ffff91604ac91c00 x1855007616247424/t4294967879(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.100906:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91c00 with x1855007616247424 ext(0->157) 00002000:00010000:3.0:1769074936.100910:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac91c00 00000100:00100000:3.0:1769074936.103318:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2419:x1855007616246912:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7233us (8921us total) trans 4294967877 rc 0/0 00000100:00100000:3.0:1769074936.103334:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 725 00002000:00100000:3.0:1769074936.103347:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x78:0x0] (0->157) req@ffff9161815f6680 x1855007616246912/t4294967877(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.103358:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6680 with x1855007616246912 ext(0->157) 00002000:00010000:3.0:1769074936.103363:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6680 00000100:00100000:3.0:1769074936.103430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.103506:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247808 00000100:00100000:3.0:1769074936.103513:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247808 00000100:00100000:3.0:1769074936.103778:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9892 00000100:00100000:3.0:1769074936.103787:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67968:x1855007616247808:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074936.103805:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.103825:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed85e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c815 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.103890:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074936.103904:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.103915:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.103929:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074936.103936:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.103941:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104005:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104012:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104018:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104024:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104029:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.104033:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104039:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104050:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.104053:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.104057:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104063:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed865 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104075:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104081:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104087:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104092:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff916044c6a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.104095:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104100:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104108:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604e58c800) 00010000:00010000:3.0:1769074936.104110:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.104112:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed86c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.104147:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed85e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c815 expref: 413 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.104157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.104159:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.104163:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed85e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c815 expref: 413 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.104172:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:3.0:1769074936.104215:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67968:x1855007616247808:12345-192.168.204.32@tcp:101:rm.0 Request processed in 429us (785us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074936.104222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9892 00000100:00100000:3.0:1769074936.106982:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2419:x1855007616247168:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9956us (10071us total) trans 4294967878 rc 0/0 00000100:00100000:3.0:1769074936.106999:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 726 00002000:00100000:3.0:1769074936.107012:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x79:0x0] (0->157) req@ffff91604ac90000 x1855007616247168/t4294967878(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074936.107022:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90000 with x1855007616247168 ext(0->157) 00002000:00010000:3.0:1769074936.107027:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90000 00000100:00100000:2.0:1769074936.110937:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2419:x1855007616247040:12345-192.168.204.32@tcp:4:cp.0 Request processed in 16178us (20637us total) trans 4294967875 rc 0/0 00000100:00100000:2.0:1769074936.110953:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 722 00002000:00100000:2.0:1769074936.110977:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x75:0x0] (0->157) req@ffff9161815f6300 x1855007616247040/t4294967875(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074936.110988:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6300 with x1855007616247040 ext(0->157) 00002000:00010000:2.0:1769074936.110995:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6300 00000100:00100000:1.0:1769074936.113378:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2419:x1855007616247296:12345-192.168.204.32@tcp:4:cp.0 Request processed in 18202us (19028us total) trans 4294967880 rc 0/0 00000100:00100000:1.0:1769074936.113392:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 723 00002000:00100000:1.0:1769074936.113405:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x72:0x0] (0->157) req@ffff9161815f5180 x1855007616247296/t4294967880(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:472/0 lens 648/448 e 0 to 0 dl 1769074947 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074936.113415:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f5180 with x1855007616247296 ext(0->157) 00002000:00010000:1.0:1769074936.113420:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f5180 00000100:00100000:0.0:1769074936.119749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.120763:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616247936 00000100:00100000:1.0:1769074936.120777:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616247936 00000100:00100000:0.0:1769074936.121193:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9893 00000100:00100000:0.0:1769074936.121205:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67969:x1855007616247936:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074936.121236:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.121257:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fed873 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c81c expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.121321:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074936.121335:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121345:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121360:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074936.121369:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121374:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121430:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121437:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121443:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121448:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.121452:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121459:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121470:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.121474:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.121478:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121484:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed87a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121892:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121901:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121907:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121912:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.121915:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121921:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121929:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604f1ad000) 00010000:00010000:0.0:1769074936.121931:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.121934:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121940:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed881 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.121987:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fed873 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c81c expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.121997:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.121999:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.122003:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fed873 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c81c expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.122012:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074936.122087:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67969:x1855007616247936:12345-192.168.204.32@tcp:101:cp.0 Request processed in 884us (2347us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074936.122095:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9893 00000100:00100000:0.0:1769074936.141785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.141943:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248064 00000100:00100000:3.0:1769074936.141954:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248064 00000100:00100000:3.0:1769074936.142034:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9894 00000100:00100000:3.0:1769074936.142043:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67969:x1855007616248064:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074936.142062:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.142084:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed888 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c823 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.142177:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074936.142192:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142203:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142217:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074936.142223:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142230:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142279:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142286:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142292:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142298:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.142302:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142309:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142320:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.142323:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.142327:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142332:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fed88f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142344:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142349:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142353:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142357:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.142361:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142366:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142372:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604e58c800) 00010000:00010000:3.0:1769074936.142375:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.142377:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142382:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed896 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074936.142411:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed888 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c823 expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.142420:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.142421:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.142424:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fed888 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c823 expref: 413 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.142432:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:3.0:1769074936.142786:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67969:x1855007616248064:12345-192.168.204.32@tcp:101:cp.0 Request processed in 742us (1008us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074936.142795:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9894 00000100:00100000:2.0:1769074936.148925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.152902:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248320 00000100:00100000:0.0:1769074936.152917:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248320 00000100:00100000:0.0:1769074936.153023:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9895 00000100:00100000:0.0:1769074936.153034:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+412:67969:x1855007616248320:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074936.153055:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.153076:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fed89d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c82a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.153195:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074936.153211:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153221:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153235:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x950fedce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074936.153242:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153248:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074936.153562:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xdd:0x0], index 1: 0 00010000:00010000:0.0:1769074936.153726:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fed8b2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074936.153736:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fed8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153747:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fed8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153780:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153786:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153791:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153797:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfa200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.153801:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153808:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153821:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.153839:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.153845:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153851:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa200/0x557988ac98fed8a4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074936.153865:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008dda184b reply state 0000000049822a55 transno 4294969188 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153875:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074936.153881:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604f1ad000) 00010000:00010000:0.0:1769074936.153884:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074936.153887:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074936.153917:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfae00/0x557988ac98fed89d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c82a expref: 415 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.153930:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfb600/0x557988ac98fed8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c82a expref: 414 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.153937:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c3:0x0].0x0 (ffff91604f1ad300) 00010000:00010000:0.0:1769074936.153939:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074936.153942:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfb600, rc 0) 00000100:00100000:0.0:1769074936.154216:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67969:x1855007616248320:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1182us (5298us total) trans 4294969188 rc 0/0 00000100:00100000:0.0:1769074936.154227:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9895 00000100:00100000:1.0:1769074936.163233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.166918:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248448 00000100:00100000:0.0:1769074936.166934:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248448 00000100:00100000:2.0:1769074936.167312:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2877 00000100:00100000:2.0:1769074936.167324:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2419:x1855007616248448:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.167343:0:24564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.167364:0:24564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c831 expref: -99 pid: 24564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074936.167394:0:24564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074936.167413:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.167415:0:24564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.167424:0:24564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 223 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.167440:0:24564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 223 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.167453:0:24564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074936.167591:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616248448:12345-192.168.204.32@tcp:101:cp.0 Request processed in 269us (4367us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.167608:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2877 00000100:00100000:1.0:1769074936.179892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.180138:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248576 00000100:00100000:0.0:1769074936.180147:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248576 00000100:00100000:0.0:1769074936.180208:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2878 00000100:00100000:0.0:1769074936.180219:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:67969:x1855007616248576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074936.180236:0:25313:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.180254:0:25313:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c838 expref: -99 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.180286:0:25313:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074936.180294:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074936.180296:0:25313:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074936.180302:0:25313:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c838 expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.180336:0:25313:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074936.180350:0:25313:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 2025 lvb_type: 1 00000100:00100000:0.0:1769074936.180364:0:25313:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626648192:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074936.180832:0:25313:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074936.193562:0:25313:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:25313:1855007626648192:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074936.193610:0:25313:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c838 expref: 224 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.193630:0:25313:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfae00, rc 0) 00000100:00100000:0.0:1769074936.193693:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67969:x1855007616248576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 13475us (13810us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074936.193701:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2878 00000100:00100000:1.0:1769074936.195498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.195631:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248704 00000100:00100000:2.0:1769074936.195640:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248704 00010000:00010000:2.0:1769074936.195691:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.195731:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1965 00000100:00100000:2.0:1769074936.195740:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614c09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2420:x1855007616248704:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074936.195754:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074936.195775:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 2025 lvb_type: 1 00010000:00010000:2.0:1769074936.195789:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 2025 lvb_type: 1 00010000:00010000:2.0:1769074936.195814:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c831 expref: 224 pid: 24564 timeout: 2025 lvb_type: 1 00010000:00010000:2.0:1769074936.195828:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.195830:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.195837:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c838 expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.195847:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c838 expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.195884:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ebfae00/0x557988ac98fed8c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c838 expref: 223 pid: 25313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074936.195897:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a42a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626648320:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074936.195994:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315a80 going to sleep for 11 seconds 00000100:00100000:1.0:1769074936.206181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.206387:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a42a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626648320:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074936.206414:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074936.206475:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614c09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2420:x1855007616248704:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10735us (10982us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.206484:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1965 00000100:00100000:3.0:1769074936.206654:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616248960 00000100:00100000:3.0:1769074936.206662:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616248960 00000100:00100000:3.0:1769074936.206703:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1950 00000100:00100000:3.0:1769074936.206711:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+415:67969:x1855007616248960:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074936.206984:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67969:x1855007616248960:12345-192.168.204.32@tcp:35:cp.0 Request processed in 272us (813us total) trans 4294969189 rc 0/0 00000100:00100000:3.0:1769074936.206991:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1950 00000100:00100000:3.0:1769074936.244172:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916149866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626648448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074936.244243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074936.244319:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626648448 00000100:00100000:3.0:1769074936.244327:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626648448 00000100:00100000:3.0:1769074936.244379:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1769074936.244389:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626648448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074936.244412:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3039232 granted 492820544 pending 458752 free 3915583488 avail 3683602432 00000100:00100000:3.0:1769074936.244456:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626648448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.244463:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00080000:3.0:1769074936.244482:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074936.244512:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967863 gen 2 00000100:00100000:3.0:1769074936.244560:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916149866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626648448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074936.245069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.245252:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1769074936.245264:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626648576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769074936.245298:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074936.245342:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249088 00000100:00100000:1.0:1769074936.245347:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249088 00000100:00100000:1.0:1769074936.245368:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626648576 00000100:00100000:1.0:1769074936.245370:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626648576 00000100:00100000:1.0:1769074936.245383:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 311 00000100:00100000:1.0:1769074936.245389:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:2419:x1855007616249088:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074936.245415:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.245432:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed8ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c83f expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.245482:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074936.245495:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245504:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245517:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074936.245523:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245556:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245618:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245624:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245630:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245635:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.245639:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245654:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245665:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.245668:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.245672:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245678:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed8d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245688:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245693:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245697:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245702:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.245705:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245710:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245717:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87c92ea6 (ffff91604464e600) 00010000:00010000:1.0:1769074936.245719:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.245722:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245727:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed8dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.245751:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed8ce lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c83f expref: 417 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.245759:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.245760:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074936.245763:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed8ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c83f expref: 417 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.245770:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc -2) 00000100:00100000:1.0:1769074936.245817:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:2419:x1855007616249088:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 427us (749us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074936.245823:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 311 00000100:00100000:1.0:1769074936.245907:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1769074936.245914:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626648576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1769074936.245935:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:1.0:1769074936.245985:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1855007626648576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.245991:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1769074936.246025:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626648576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769074936.249300:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626648704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074936.249370:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074936.250114:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626648832:0@lo:400:kworker.0 00000100:00100000:2.0:1769074936.250184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074936.250257:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626648832 00000100:00100000:1.0:1769074936.250265:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626648832 00000100:00100000:1.0:1769074936.250312:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1769074936.250320:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626648832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074936.250437:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626648832:12345-0@lo:400:kworker.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.250446:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1769074936.250497:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1855007626648960:0@lo:400:kworker.0 00000100:00100000:1.0:1769074936.250523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074936.250555:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626648704 00000100:00100000:3.0:1769074936.250560:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626648704 00000100:00100000:1.0:1769074936.250576:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626648960 00000100:00100000:1.0:1769074936.250579:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626648960 00000100:00100000:3.0:1769074936.250602:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1769074936.250609:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626648704:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074936.250618:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1769074936.250624:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1855007626648960:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1769074936.250635:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:1.0:1769074936.250669:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1855007626648960:12345-0@lo:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.250669:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626648704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.250676:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1769074936.250676:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1769074936.250707:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1855007626648960:0@lo:400:kworker.0 00000100:00100000:1.0:1769074936.250741:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626648704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074936.251170:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1855007626649472:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251200:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074936.251217:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626649984:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251235:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074936.251248:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1769074936.251253:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1855007626649344:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251271:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074936.251284:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626649856:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074936.251309:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626649088:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251330:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649856 00000100:00100000:0.0:1769074936.251333:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649856 00000100:00100000:3.0:1769074936.251333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074936.251348:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626649600:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251370:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074936.251374:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649600 00000100:00100000:0.0:1769074936.251377:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649600 00000100:00100000:3.0:1769074936.251383:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1769074936.251400:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1769074936.251400:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1855007626649216:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251405:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626649856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074936.251434:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626649728:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251437:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626649856:12345-0@lo:400:kworker.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074936.251443:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1769074936.251451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074936.251456:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649728 00000100:00100000:0.0:1769074936.251459:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649728 00000100:00100000:3.0:1769074936.251470:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649472 00000100:00100000:3.0:1769074936.251473:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649472 00000100:00100000:0.0:1769074936.251479:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1769074936.251483:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626649600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251499:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649984 00000100:00100000:3.0:1769074936.251501:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649984 00000100:00100000:0.0:1769074936.251512:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626649600:12345-0@lo:400:kworker.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074936.251518:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1769074936.251518:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649344 00000100:00100000:3.0:1769074936.251521:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649344 00000100:00100000:0.0:1769074936.251527:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:0.0:1769074936.251552:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626649728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251552:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649088 00000100:00100000:3.0:1769074936.251555:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649088 00000100:00100000:3.0:1769074936.251566:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626649216 00000100:00100000:3.0:1769074936.251568:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626649216 00000100:00100000:0.0:1769074936.251579:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626649728:12345-0@lo:400:kworker.0 Request processed in 28us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074936.251584:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:3.0:1769074936.251594:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:3.0:1769074936.251600:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1855007626649472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251630:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1855007626649472:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.251636:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:3.0:1769074936.251648:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:3.0:1769074936.251654:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626649984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251675:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626649984:12345-0@lo:400:kworker.0 Request processed in 23us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.251683:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00100000:3.0:1769074936.251693:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:3.0:1769074936.251699:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1855007626649344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251722:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1855007626649344:12345-0@lo:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.251728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:3.0:1769074936.251738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1769074936.251744:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626649088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251768:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916149866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626649088:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.251773:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00080000:0.0:1769074936.251782:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074936.251784:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00080000:0.0:1769074936.251786:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1769074936.251789:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074936.251789:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1855007626649216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1769074936.251791:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1769074936.251811:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1855007626649344:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251813:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1855007626649216:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074936.251818:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:0.0:1769074936.251821:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626649856:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251829:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1855007626649472:0@lo:400:kworker.0 00000100:00100000:0.0:1769074936.251837:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626649984:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251844:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1855007626649216:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251851:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626649728:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251859:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626649088:0@lo:400:kworker.0 00000100:00100000:3.0:1769074936.251866:0:3656:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967875 gen 2 00000100:00100000:3.0:1769074936.252550:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626649600:0@lo:400:kworker.0 00000100:00100000:2.0:1769074936.254119:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626648832:0@lo:400:kworker.0 00000100:00100000:1.0:1769074936.295921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.296099:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249216 00000100:00100000:3.0:1769074936.296109:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249216 00000100:00100000:3.0:1769074936.296175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9896 00000100:00100000:3.0:1769074936.296185:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67973:x1855007616249216:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074936.296205:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.296224:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed8e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c846 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.296576:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074936.296592:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.296603:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.296618:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074936.296624:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074936.296630:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296911:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296920:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296926:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296932:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296937:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.296942:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296949:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296961:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.296974:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.296979:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.296986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fed8ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297002:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297007:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297013:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297019:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.297021:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297028:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297034:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604e58c800) 00010000:00010000:2.0:1769074936.297036:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.297038:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297043:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fed8f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.297077:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed8e3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c846 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.297086:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.297088:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.297091:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed8e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c846 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.297099:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:2.0:1769074936.297176:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67973:x1855007616249216:12345-192.168.204.32@tcp:101:bash.0 Request processed in 992us (1263us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.297184:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9896 00000100:00100000:1.0:1769074936.337235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.337284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.337423:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249344 00000100:00100000:2.0:1769074936.337434:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249344 00000100:00100000:2.0:1769074936.337501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9897 00000100:00100000:2.0:1769074936.337511:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67974:x1855007616249344:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074936.337563:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.337584:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c854 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.337662:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.337676:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337687:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337702:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.337709:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337715:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337780:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337787:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337794:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337800:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337807:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.337811:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337819:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337832:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.337835:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.337839:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337845:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed8ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337858:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337864:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337868:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337874:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.337876:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337881:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337888:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604f4df900) 00010000:00010000:2.0:1769074936.337891:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.337894:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337900:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed906 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.337929:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8f8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c854 expref: 417 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.337938:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.337940:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.337944:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed8f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c854 expref: 417 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.337953:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074936.338019:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67974:x1855007616249344:12345-192.168.204.32@tcp:101:rm.0 Request processed in 509us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.338026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9897 00000100:00100000:3.0:1769074936.340415:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249472 00000100:00100000:3.0:1769074936.340431:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249472 00000100:00100000:3.0:1769074936.340502:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 314 00000100:00100000:3.0:1769074936.340513:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:2420:x1855007616249472:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074936.340576:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.340598:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed90d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c84d expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.340671:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074936.340686:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.340695:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.340711:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:3.0:1769074936.340717:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.340723:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341328:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341340:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341347:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341353:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.341358:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341365:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341381:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.341384:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.341389:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341395:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fed914 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341415:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341421:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341425:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341430:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.341433:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341438:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341445:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xda3247e6 (ffff91604e58c100) 00010000:00010000:3.0:1769074936.341447:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.341449:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341454:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fed91b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xda3247e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:3.0:1769074936.341487:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed90d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c84d expref: 417 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.341497:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.341500:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074936.341503:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fed90d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c84d expref: 417 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.341512:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423200, rc -2) 00000100:00100000:3.0:1769074936.342596:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:2420:x1855007616249472:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 2078us (5304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074936.342608:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 314 00000100:00100000:3.0:1769074936.359675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.359852:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249600 00000100:00100000:2.0:1769074936.359863:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249600 00000100:00100000:2.0:1769074936.359924:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9898 00000100:00100000:2.0:1769074936.359933:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67974:x1855007616249600:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074936.359955:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.359986:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed922 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c85b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.360052:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074936.360065:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360077:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360092:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074936.360100:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360105:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360165:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360172:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360178:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360184:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.360188:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360194:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360206:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.360209:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.360213:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360219:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed929 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360233:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360239:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360245:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360250:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.360253:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360259:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360266:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604f4df900) 00010000:00010000:2.0:1769074936.360269:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.360272:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360279:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed930 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.360310:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed922 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c85b expref: 417 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.360319:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.360321:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.360325:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed922 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c85b expref: 417 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.360338:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074936.360402:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67974:x1855007616249600:12345-192.168.204.32@tcp:101:rm.0 Request processed in 469us (735us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.360410:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9898 00000100:00100000:2.0:1769074936.409615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.409755:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249728 00000100:00100000:1.0:1769074936.409778:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249728 00000100:00100000:1.0:1769074936.409842:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9899 00000100:00100000:1.0:1769074936.409852:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67975:x1855007616249728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.409873:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.409894:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed937 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c862 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.409991:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.410005:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410016:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410030:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.410036:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410042:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410098:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410106:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410111:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410118:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410133:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.410138:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410145:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.410160:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.410164:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410169:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed93e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410183:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410188:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410193:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410199:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.410201:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410207:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410217:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604464e600) 00010000:00010000:1.0:1769074936.410219:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.410222:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410227:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed945 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.410256:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed937 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c862 expref: 417 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.410265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.410267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.410270:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed937 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c862 expref: 417 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.410278:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074936.410344:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67975:x1855007616249728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 493us (739us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.410351:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9899 00000100:00100000:0.0:1769074936.417214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.417374:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616249856 00000100:00100000:2.0:1769074936.417384:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616249856 00000100:00100000:2.0:1769074936.417436:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9900 00000100:00100000:2.0:1769074936.417446:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67975:x1855007616249856:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.417468:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.417488:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed94c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c869 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.417583:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074936.417599:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417611:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417626:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074936.417632:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417649:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417706:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417713:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417721:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417727:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.417731:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417738:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417750:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.417754:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.417759:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417765:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fed953 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417779:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417786:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417791:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417796:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9fe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.417799:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417806:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417813:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604f4df900) 00010000:00010000:2.0:1769074936.417816:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.417818:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417824:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fed95a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074936.417856:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed94c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c869 expref: 417 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.417865:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.417867:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.417871:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f600/0x557988ac98fed94c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c869 expref: 417 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.417879:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074936.417944:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67975:x1855007616249856:12345-192.168.204.32@tcp:101:cp.0 Request processed in 498us (739us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.417952:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9900 00000100:00100000:3.0:1769074936.423684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.423859:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250112 00000100:00100000:1.0:1769074936.423871:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250112 00000100:00100000:1.0:1769074936.423928:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9901 00000100:00100000:1.0:1769074936.423937:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+416:67975:x1855007616250112:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.423958:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.423988:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed961 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c870 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.424106:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.424133:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.424151:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.424165:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x5f135090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.424172:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.424178:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074936.424481:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xdd:0x0], index 0: 0 00010000:00010000:1.0:1769074936.424941:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed976 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.424955:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed976 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.424973:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed976 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425010:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425016:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425026:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425032:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425038:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.425042:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425049:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425061:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.425064:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.425068:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425074:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed968 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074936.425086:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b3d32ec reply state 00000000a4a2a499 transno 4294969190 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425095:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.425101:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604464e600) 00010000:00010000:1.0:1769074936.425103:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074936.425106:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074936.425433:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fed961 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c870 expref: 419 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.425460:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2000/0x557988ac98fed976 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c870 expref: 418 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.425467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c4:0x0].0x0 (ffff91604464e100) 00010000:00010000:1.0:1769074936.425470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074936.425473:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2000, rc 0) 00000100:00100000:1.0:1769074936.425806:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67975:x1855007616250112:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1868us (2129us total) trans 4294969190 rc 0/0 00000100:00100000:1.0:1769074936.425815:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9901 00000100:00100000:3.0:1769074936.438071:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.438247:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250240 00000100:00100000:1.0:1769074936.438258:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250240 00000100:00100000:1.0:1769074936.438326:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2879 00000100:00100000:1.0:1769074936.438336:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2417:x1855007616250240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.438355:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.438377:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c877 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074936.438403:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074936.438422:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.438425:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.438433:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 233 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074936.438450:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 233 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074936.438468:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074936.438527:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616250240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 192us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.438574:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2879 00000100:00100000:0.0:1769074936.444136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.444379:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250368 00000100:00100000:2.0:1769074936.444391:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250368 00000100:00100000:2.0:1769074936.444456:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2880 00000100:00100000:2.0:1769074936.444466:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:67975:x1855007616250368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.444493:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.444517:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c87e expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.444585:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 234 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.444594:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.444596:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.444600:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c87e expref: 234 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.444712:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 234 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.444729:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 234 pid: 24956 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.444743:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626650112:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074936.444924:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315600 going to sleep for 11 seconds 00000100:00100000:3.0:1769074936.458686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.458789:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250496 00000100:00100000:1.0:1769074936.458800:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250496 00010000:00010000:1.0:1769074936.458854:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 235 pid: 24956 timeout: 2025 lvb_type: 1 00000100:00100000:1.0:1769074936.458896:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1966 00000100:00100000:1.0:1769074936.458905:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2419:x1855007616250496:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074936.458919:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074936.458942:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 235 pid: 24956 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074936.458956:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 235 pid: 24956 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074936.458992:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.458995:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.459002:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c87e expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.459013:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c87e expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.459056:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c87e expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074936.459070:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626650240:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074936.459166:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1769074936.460006:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2800/0x557988ac98fed984 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c877 expref: 235 pid: 24956 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.460023:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626650112:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074936.460049:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f600/0x557988ac98fed98b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c87e expref: 234 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.460065:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f600, rc 0) 00000100:00100000:2.0:1769074936.460118:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:67975:x1855007616250368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 15653us (16000us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.460134:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2880 00000100:00100000:1.0:1769074936.467353:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626650240:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074936.467380:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074936.467499:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2419:x1855007616250496:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8593us (8821us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.467511:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1966 00000100:00100000:0.0:1769074936.482444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.487795:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250752 00000100:00100000:1.0:1769074936.487814:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250752 00000100:00100000:1.0:1769074936.488394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1951 00000100:00100000:1.0:1769074936.488406:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+419:67975:x1855007616250752:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074936.488744:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67975:x1855007616250752:12345-192.168.204.32@tcp:35:cp.0 Request processed in 341us (6311us total) trans 4294969191 rc 0/0 00000100:00100000:1.0:1769074936.488753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1951 00000100:00100000:3.0:1769074936.523778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.523890:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616250880 00000100:00100000:1.0:1769074936.523901:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616250880 00000100:00100000:1.0:1769074936.523982:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 315 00000100:00100000:1.0:1769074936.523991:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2420:x1855007616250880:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074936.524043:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.524062:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed992 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c885 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.524119:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074936.524131:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524141:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524153:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074936.524159:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524165:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524209:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524215:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524221:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524227:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.524231:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524238:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524252:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.524255:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.524259:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524265:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed999 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524276:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524281:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524286:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524291:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.524294:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524299:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524305:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604464ed00) 00010000:00010000:1.0:1769074936.524316:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.524319:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524324:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9a0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.524348:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed992 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c885 expref: 421 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.524357:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.524360:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074936.524363:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed992 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c885 expref: 421 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.524371:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc -2) 00000100:00100000:1.0:1769074936.524435:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2420:x1855007616250880:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 445us (667us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074936.524443:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 315 00000100:00100000:0.0:1769074936.561256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.561385:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251008 00000100:00100000:1.0:1769074936.561396:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251008 00000100:00100000:1.0:1769074936.561516:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9902 00000100:00100000:1.0:1769074936.561527:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67980:x1855007616251008:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074936.561584:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.561606:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c8bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.561685:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.561700:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561711:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561723:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.561734:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561740:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561792:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561799:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561805:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561810:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561816:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.561822:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561830:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561858:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.561862:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.561866:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561872:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561886:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561892:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561898:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561902:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.561906:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561911:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561918:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604464ed00) 00010000:00010000:1.0:1769074936.561920:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.561923:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561928:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.561955:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9a7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8bd expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.561977:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.561980:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.561983:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8bd expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.561992:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074936.562057:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67980:x1855007616251008:12345-192.168.204.32@tcp:101:bash.0 Request processed in 531us (810us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.562066:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9902 00000100:00100000:2.0:1769074936.575202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.575326:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251136 00000100:00100000:1.0:1769074936.575338:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251136 00000100:00100000:1.0:1769074936.575398:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9903 00000100:00100000:1.0:1769074936.575408:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67981:x1855007616251136:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074936.575434:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.575454:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c8c4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.575567:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.575583:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.575594:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.575608:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.575615:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.575622:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575931:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575940:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575946:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575952:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575967:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.575971:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575978:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.575991:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.575994:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.575998:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576004:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fed9c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576020:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576025:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576030:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576034:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.576036:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576041:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576047:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604464ed00) 00010000:00010000:2.0:1769074936.576049:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.576051:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576056:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fed9ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.576087:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9bc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8c4 expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.576096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.576098:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.576102:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fed9bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8c4 expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.576115:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:2.0:1769074936.576191:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67981:x1855007616251136:12345-192.168.204.32@tcp:101:rm.0 Request processed in 783us (997us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.576198:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9903 00000100:00100000:3.0:1769074936.576894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.577055:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251264 00000100:00100000:0.0:1769074936.577066:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251264 00000100:00100000:0.0:1769074936.577123:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 316 00000100:00100000:0.0:1769074936.577132:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2420:x1855007616251264:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074936.577180:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.577195:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fed9d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c8cb expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.577243:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074936.577258:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577269:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577281:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074936.577286:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577290:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577327:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577331:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577335:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577339:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.577342:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577346:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577353:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.577355:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.577357:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577361:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fed9d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577368:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577371:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577375:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577378:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.577380:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577383:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577387:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604f1adf00) 00010000:00010000:0.0:1769074936.577388:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.577389:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577392:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.577407:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fed9d1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8cb expref: 421 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.577412:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.577413:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074936.577415:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfa600/0x557988ac98fed9d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c8cb expref: 421 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.577420:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ebfa600, rc -2) 00000100:00100000:0.0:1769074936.577462:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2420:x1855007616251264:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 332us (571us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074936.577466:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 316 00000100:00100000:0.0:1769074936.580581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.580664:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251392 00000100:00100000:2.0:1769074936.580675:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251392 00000100:00100000:2.0:1769074936.580723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9904 00000100:00100000:2.0:1769074936.580733:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67981:x1855007616251392:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074936.580753:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.580773:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed9e6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c903 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.580848:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.580864:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580875:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580890:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.580898:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580904:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580973:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580982:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580988:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.580995:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581002:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.581006:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581014:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581025:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.581029:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.581033:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581040:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98fed9ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581054:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581060:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581067:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581073:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.581076:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581083:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581090:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604f4df900) 00010000:00010000:2.0:1769074936.581092:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.581095:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581101:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fed9f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.581131:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed9e6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c903 expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.581141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.581144:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.581147:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fed9e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c903 expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.581156:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:2.0:1769074936.581219:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67981:x1855007616251392:12345-192.168.204.32@tcp:101:rm.0 Request processed in 488us (690us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.581227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9904 00000100:00100000:2.0:1769074936.603083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074936.603187:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251520 00000100:00100000:0.0:1769074936.603198:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251520 00000100:00100000:0.0:1769074936.603260:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9905 00000100:00100000:0.0:1769074936.603270:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67984:x1855007616251520:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074936.603291:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.603312:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c90a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.603374:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074936.603388:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603399:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603412:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074936.603418:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603424:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603476:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603483:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1769074936.603486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:0.0:1769074936.603489:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603499:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603505:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.603509:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603522:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603558:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.603562:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.603567:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603573:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98feda02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603586:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603591:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603596:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603601:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1efa00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.603604:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603609:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603619:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604f1adf00) 00010000:00010000:0.0:1769074936.603621:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.603624:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603629:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98feda09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074936.603658:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9fb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c90a expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.603668:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.603670:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.603673:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fed9fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c90a expref: 421 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.603682:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef600, rc 0) 00000100:00100000:0.0:1769074936.603737:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67984:x1855007616251520:12345-192.168.204.32@tcp:101:cp.0 Request processed in 468us (662us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074936.603744:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9905 00000100:00100000:3.0:1769074936.607204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.607389:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251776 00000100:00100000:1.0:1769074936.607400:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251776 00000100:00100000:1.0:1769074936.607460:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9906 00000100:00100000:1.0:1769074936.607469:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67984:x1855007616251776:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.607491:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.607513:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c949 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.607622:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.607636:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607648:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607663:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.607669:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607676:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607734:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607741:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607747:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607752:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.607756:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607767:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607785:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.607788:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.607793:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607799:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98feda17 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607816:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607822:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607827:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607831:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.607834:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607841:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607847:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604464ed00) 00010000:00010000:1.0:1769074936.607850:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.607853:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607858:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98feda1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.607889:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda10 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c949 expref: 421 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.607899:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.607901:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.607905:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c949 expref: 421 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.607913:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074936.607984:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67984:x1855007616251776:12345-192.168.204.32@tcp:101:cp.0 Request processed in 515us (788us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.607992:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9906 00000100:00100000:2.0:1769074936.613050:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616251648 00000100:00100000:2.0:1769074936.613067:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616251648 00000100:00100000:2.0:1769074936.613146:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 317 00000100:00100000:2.0:1769074936.613156:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2419:x1855007616251648:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074936.613207:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.613226:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c911 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.613279:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074936.613292:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613303:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613316:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074936.613322:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613329:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613385:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613391:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613398:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613407:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.613412:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613418:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613430:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.613434:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.613438:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613444:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda2c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613457:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613462:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613468:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613473:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ec00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.613475:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613480:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613488:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604f4df900) 00010000:00010000:2.0:1769074936.613490:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.613493:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613499:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.613527:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda25 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c911 expref: 421 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.613553:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.613555:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074936.613560:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda25 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c911 expref: 421 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.613845:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc -2) 00000100:00100000:2.0:1769074936.613916:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:2419:x1855007616251648:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 761us (10428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074936.613923:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 317 00000100:00100000:3.0:1769074936.614198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.616489:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252032 00000100:00100000:2.0:1769074936.616504:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252032 00000100:00100000:1.0:1769074936.616659:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9907 00000100:00100000:1.0:1769074936.616672:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+420:67984:x1855007616252032:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.616692:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.616713:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda3a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c950 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.616826:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.616840:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.616851:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.616866:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x9220af6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.616873:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.616880:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074936.617166:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xde:0x0], index 1: 0 00010000:00010000:1.0:1769074936.617321:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feda4f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.617331:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feda4f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617337:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feda4f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617367:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617374:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617380:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617386:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.617389:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617396:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617406:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.617410:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.617414:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617420:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda41 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074936.617432:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003f171103 reply state 000000007ef5a8eb transno 4294969192 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617443:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.617448:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604464e800) 00010000:00010000:1.0:1769074936.617450:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074936.617452:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074936.617480:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda3a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c950 expref: 423 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.617493:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916052b15c00/0x557988ac98feda4f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c950 expref: 422 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.617501:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c5:0x0].0x0 (ffff916052aa4f00) 00010000:00010000:1.0:1769074936.617503:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074936.617506:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916052b15c00, rc 0) 00000100:00100000:1.0:1769074936.617612:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67984:x1855007616252032:12345-192.168.204.32@tcp:101:cp.0 Request processed in 943us (3414us total) trans 4294969192 rc 0/0 00000100:00100000:1.0:1769074936.617620:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9907 00000100:00100000:3.0:1769074936.625386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.625861:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252160 00000100:00100000:2.0:1769074936.625873:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252160 00000100:00100000:2.0:1769074936.625929:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2881 00000100:00100000:2.0:1769074936.625938:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2418:x1855007616252160:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.625985:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.626008:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c957 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074936.626031:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074936.626050:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.626053:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.626061:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 224 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.626076:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 224 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.626088:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:2.0:1769074936.626142:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2418:x1855007616252160:12345-192.168.204.32@tcp:101:cp.0 Request processed in 205us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.626150:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2881 00000100:00100000:3.0:1769074936.635622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.635679:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252288 00000100:00100000:1.0:1769074936.635690:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252288 00000100:00100000:2.0:1769074936.635794:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2882 00000100:00100000:2.0:1769074936.635807:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:67984:x1855007616252288:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.635827:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.635845:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c95e expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.635877:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 225 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.635885:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.635887:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.635891:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c95e expref: 225 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.635926:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 225 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.635944:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 225 pid: 8405 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.635954:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626650368:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074936.636081:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315300 going to sleep for 11 seconds 00000100:00100000:0.0:1769074936.642074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.642140:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252416 00000100:00100000:1.0:1769074936.642151:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252416 00010000:00010000:1.0:1769074936.642290:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 226 pid: 8405 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.642296:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8405:1855007626650368:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074936.642323:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c95e expref: 226 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.642339:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ec00, rc 0) 00000100:00100000:1.0:1769074936.642432:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1967 00000100:00100000:1.0:1769074936.642443:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616252416:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1769074936.642457:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1769074936.642475:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 226 pid: 8405 timeout: 2025 lvb_type: 1 00000100:00100000:2.0:1769074936.642475:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:67984:x1855007616252288:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6671us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.642482:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2882 00010000:00010000:1.0:1769074936.642488:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 226 pid: 8405 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074936.642512:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9e800/0x557988ac98feda5d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c957 expref: 225 pid: 8405 timeout: 2025 lvb_type: 1 00010000:00010000:1.0:1769074936.642526:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.642528:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.643014:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c95e expref: 224 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.643027:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c95e expref: 224 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.643068:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ec00/0x557988ac98feda64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c95e expref: 224 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1769074936.643082:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626650496:192.168.204.32@tcp:105: 00000100:00100000:1.0:1769074936.643152:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f180 going to sleep for 11 seconds 00000100:00100000:1.0:1769074936.647203:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1855007626650496:192.168.204.32@tcp:105: 00010000:00010000:1.0:1769074936.647232:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1769074936.647300:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616252416:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4858us (5231us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.647312:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1967 00000100:00100000:0.0:1769074936.649813:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.650003:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252672 00000100:00100000:1.0:1769074936.650014:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252672 00000100:00100000:1.0:1769074936.650064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1952 00000100:00100000:1.0:1769074936.650074:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+423:67984:x1855007616252672:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074936.650443:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67984:x1855007616252672:12345-192.168.204.32@tcp:35:cp.0 Request processed in 369us (638us total) trans 4294969193 rc 0/0 00000100:00100000:1.0:1769074936.650452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1952 00000100:00100000:0.0:1769074936.680642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.680730:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252800 00000100:00100000:2.0:1769074936.680744:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252800 00000100:00100000:2.0:1769074936.680802:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 318 00000100:00100000:2.0:1769074936.680813:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:2420:x1855007616252800:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074936.680880:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.680902:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda6b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c965 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.681136:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074936.681151:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681165:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681180:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074936.681186:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681191:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681242:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681250:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681256:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681263:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.681267:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681276:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681288:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.681292:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.681297:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681302:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98feda72 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681317:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681323:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681329:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681334:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.681337:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681342:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681348:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89c00) 00010000:00010000:2.0:1769074936.681350:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.681353:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681357:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98feda79 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074936.681387:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda6b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c965 expref: 425 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.681395:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.681397:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074936.681400:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c965 expref: 425 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.681413:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc -2) 00000100:00100000:2.0:1769074936.681484:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:2420:x1855007616252800:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 674us (851us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074936.681492:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 318 00000100:00100000:3.0:1769074936.698426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.698513:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616252928 00000100:00100000:1.0:1769074936.698525:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616252928 00000100:00100000:1.0:1769074936.698615:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9908 00000100:00100000:1.0:1769074936.698624:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67991:x1855007616252928:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074936.698645:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.698669:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda80 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c99d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.698746:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.698761:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698772:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698788:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.698794:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698800:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698864:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698871:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698877:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698882:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.698886:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698894:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698906:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.698909:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.698912:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698918:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98feda87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698929:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698935:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698940:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698945:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.698948:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698967:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698975:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4900) 00010000:00010000:1.0:1769074936.698977:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.698980:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.698985:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98feda8e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.699015:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda80 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c99d expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.699024:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.699025:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.699028:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c99d expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.699036:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2400, rc 0) 00000100:00100000:1.0:1769074936.699093:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:67991:x1855007616252928:12345-192.168.204.32@tcp:101:bash.0 Request processed in 470us (678us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.699101:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9908 00000100:00100000:3.0:1769074936.722003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.722048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.722116:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253184 00000100:00100000:1.0:1769074936.722127:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253184 00000100:00100000:2.0:1769074936.722202:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253056 00000100:00100000:2.0:1769074936.722207:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253056 00000100:00100000:1.0:1769074936.722236:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 319 00000100:00100000:2.0:1769074936.722245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9909 00000100:00100000:1.0:1769074936.722247:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:2419:x1855007616253184:12345-192.168.204.32@tcp:63:ll_sa.0 00000100:00100000:2.0:1769074936.722251:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+425:67992:x1855007616253056:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074936.722267:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.722288:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c9a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.722299:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.722306:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda9c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c9ab expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.722345:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.722351:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074936.722360:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.722374:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.722389:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.722395:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.722401:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.722458:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.722603:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722613:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722626:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074936.722633:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722639:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722662:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722669:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722675:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722680:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.722684:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722691:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722702:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.722705:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.722710:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722715:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedaaa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722728:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722734:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722739:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722744:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.722746:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722764:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722775:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff916052aa4900) 00010000:00010000:1.0:1769074936.722777:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.722781:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722786:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedab8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074936.722821:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda9c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9ab expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.722831:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.722833:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074936.722836:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98feda9c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9ab expref: 427 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.722845:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2400, rc -2) 00000100:00100000:1.0:1769074936.722904:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+426:2419:x1855007616253184:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 658us (854us total) trans 0 rc -2/-2 00000100:00100000:1.0:1769074936.722911:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 319 00010000:00010000:2.0:1769074936.726034:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726052:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726060:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726066:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.726072:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726082:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.726102:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.726107:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726183:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedaa3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726276:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726283:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726288:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726294:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.726297:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726302:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726311:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff91604ec89c00) 00010000:00010000:2.0:1769074936.726313:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.726317:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726322:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedab1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.726371:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda95 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9a4 expref: 425 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.726382:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.726385:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.726388:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98feda95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9a4 expref: 425 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.726396:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074936.726695:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67992:x1855007616253056:12345-192.168.204.32@tcp:101:rm.0 Request processed in 4441us (4700us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.726705:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9909 00000100:00100000:3.0:1769074936.737421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.737764:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253312 00000100:00100000:1.0:1769074936.737776:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253312 00000100:00100000:1.0:1769074936.737835:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9910 00000100:00100000:1.0:1769074936.737845:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67992:x1855007616253312:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074936.737866:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.737888:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedabf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c9e3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.737969:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.737985:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.737995:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738012:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074936.738018:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738025:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738077:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738084:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738089:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738095:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738101:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.738105:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738116:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.738131:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.738135:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738141:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedac6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738155:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738161:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738167:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738172:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.738175:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738181:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738188:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4500) 00010000:00010000:1.0:1769074936.738190:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.738193:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738198:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedacd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074936.738228:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedabf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9e3 expref: 425 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.738239:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.738241:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.738245:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedabf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9e3 expref: 425 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.738254:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074936.738315:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67992:x1855007616253312:12345-192.168.204.32@tcp:101:rm.0 Request processed in 470us (904us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.738322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9910 00000100:00100000:0.0:1769074936.755796:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1769074936.755819:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626650624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769074936.755889:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074936.755971:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626650624 00000100:00100000:2.0:1769074936.755981:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626650624 00000100:00100000:2.0:1769074936.756037:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1769074936.756047:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626650624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1769074936.756076:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2924544 granted 492742720 pending 344064 free 3764301824 avail 3532779520 00000100:00100000:2.0:1769074936.756136:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626650624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.756144:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1769074936.756150:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1769074936.756159:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626650752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769074936.756187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074936.756288:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626650752 00000100:00100000:2.0:1769074936.756293:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626650752 00000100:00100000:2.0:1769074936.756325:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1769074936.756331:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626650752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1769074936.756343:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3039232 granted 492820544 pending 458752 free 3915583488 avail 3683602432 00000100:00100000:2.0:1769074936.756374:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626650752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.756381:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1769074936.756451:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626650752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1769074936.756452:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9161815f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626650624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1769074936.775475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.775570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.775718:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253568 00000100:00100000:2.0:1769074936.775729:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253568 00000100:00100000:2.0:1769074936.775792:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 320 00000100:00100000:2.0:1769074936.775802:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:2420:x1855007616253568:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074936.775878:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.775900:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedad4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c9f1 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.775969:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074936.775985:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.775997:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776011:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074936.776018:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776024:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776094:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776101:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776108:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776113:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.776117:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776123:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776135:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.776138:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.776143:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776148:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedadb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776162:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776168:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776173:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776178:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9ee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.776180:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776186:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776193:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89c00) 00010000:00010000:2.0:1769074936.776195:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.776198:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776203:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedae2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074936.776235:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedad4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9f1 expref: 425 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.776245:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.776248:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074936.776251:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedad4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9f1 expref: 425 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.776260:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc -2) 00000100:00100000:2.0:1769074936.776327:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:2420:x1855007616253568:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 526us (754us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074936.776335:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 320 00000100:00100000:1.0:1769074936.777163:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253440 00000100:00100000:1.0:1769074936.777173:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253440 00000100:00100000:1.0:1769074936.777836:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9911 00000100:00100000:1.0:1769074936.777846:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67995:x1855007616253440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.777861:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.777877:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedae9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2c9ea expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.777925:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.777939:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.777946:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.777969:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.777976:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.777983:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778026:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778034:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778040:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778046:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.778049:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778056:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778066:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.778070:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.778074:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778079:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedaf0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778090:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778096:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778100:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778104:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2e00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.778107:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778112:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778118:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4500) 00010000:00010000:1.0:1769074936.778120:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.778122:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778127:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedaf7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.778809:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedae9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9ea expref: 425 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.778821:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.778823:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.778826:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedae9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2c9ea expref: 425 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.778832:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095600, rc 0) 00000100:00100000:1.0:1769074936.778893:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67995:x1855007616253440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1048us (3426us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.778901:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9911 00000100:00100000:2.0:1769074936.784922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.784993:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253696 00000100:00100000:1.0:1769074936.785005:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253696 00000100:00100000:1.0:1769074936.785110:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9912 00000100:00100000:1.0:1769074936.785122:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67995:x1855007616253696:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.785142:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.785163:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedafe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca29 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.785248:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.785264:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785275:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785291:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.785297:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785301:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785351:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785357:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785363:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785369:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.785373:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785380:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785392:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.785396:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.785400:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785406:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedb05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785415:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785419:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785422:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785425:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.785427:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785431:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785435:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4900) 00010000:00010000:1.0:1769074936.785436:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.785438:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785441:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb0c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.785464:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedafe lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca29 expref: 425 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.785470:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.785472:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.785474:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedafe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca29 expref: 425 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.785479:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:1.0:1769074936.785556:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67995:x1855007616253696:12345-192.168.204.32@tcp:101:cp.0 Request processed in 436us (643us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.785563:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9912 00000100:00100000:3.0:1769074936.792732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.792824:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616253952 00000100:00100000:1.0:1769074936.792836:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616253952 00000100:00100000:1.0:1769074936.792951:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9913 00000100:00100000:1.0:1769074936.792973:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+424:67995:x1855007616253952:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.793009:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.793032:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedb13 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca30 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.793168:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.793192:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793205:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793227:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x8eac725e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.793234:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793240:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:1.0:1769074936.793619:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xde:0x0], index 0: 0 00010000:00010000:1.0:1769074936.793772:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedb28 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.793782:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedb28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793790:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedb28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793825:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793833:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793840:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793845:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.793849:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793856:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793869:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.793872:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.793877:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793883:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb1a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:1.0:1769074936.793895:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000604514d0 reply state 00000000869a63ce transno 4294969194 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793905:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.793911:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4500) 00010000:00010000:1.0:1769074936.793914:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074936.793917:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074936.793948:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2e00/0x557988ac98fedb13 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca30 expref: 427 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.793978:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095800/0x557988ac98fedb28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca30 expref: 426 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.793985:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c6:0x0].0x0 (ffff916052aa4300) 00010000:00010000:1.0:1769074936.793987:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074936.793990:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604e095800, rc 0) 00000100:00100000:1.0:1769074936.794068:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67995:x1855007616253952:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1097us (1346us total) trans 4294969194 rc 0/0 00000100:00100000:1.0:1769074936.794076:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9913 00000100:00100000:0.0:1769074936.805616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.805895:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254080 00000100:00100000:2.0:1769074936.805906:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254080 00000100:00100000:2.0:1769074936.805965:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2883 00000100:00100000:2.0:1769074936.805976:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2419:x1855007616254080:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074936.805994:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074936.806017:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca37 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074936.806043:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074936.806065:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.806067:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.806075:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 234 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.806093:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 234 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074936.806107:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074936.806183:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2419:x1855007616254080:12345-192.168.204.32@tcp:101:cp.0 Request processed in 208us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.806199:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2883 00000100:00100000:3.0:1769074936.814585:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.814918:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254208 00000100:00100000:1.0:1769074936.814931:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254208 00000100:00100000:1.0:1769074936.815009:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2884 00000100:00100000:1.0:1769074936.815021:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:67995:x1855007616254208:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.815041:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.815063:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca3e expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.815097:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 235 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074936.815104:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.815106:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074936.815110:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca3e expref: 235 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.815142:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 235 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074936.815157:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 235 pid: 8405 timeout: 2026 lvb_type: 1 00000100:00100000:1.0:1769074936.815170:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24956:1855007626650880:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074936.815293:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074936.820856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.820962:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254336 00000100:00100000:2.0:1769074936.820972:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254336 00010000:00010000:2.0:1769074936.821023:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 236 pid: 8405 timeout: 2026 lvb_type: 1 00000100:00100000:2.0:1769074936.821067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1968 00000100:00100000:2.0:1769074936.821076:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2420:x1855007616254336:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074936.821090:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074936.821110:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 236 pid: 8405 timeout: 2026 lvb_type: 1 00010000:00010000:2.0:1769074936.821123:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 236 pid: 8405 timeout: 2026 lvb_type: 1 00010000:00010000:2.0:1769074936.821148:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.821151:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074936.821157:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca3e expref: 236 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.821168:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca3e expref: 236 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.821204:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca3e expref: 236 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074936.821217:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626651008:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074936.821312:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315d80 going to sleep for 11 seconds 00010000:00010000:1.0:1769074936.821822:0:24956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedb36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca37 expref: 236 pid: 8405 timeout: 2026 lvb_type: 1 00000100:00100000:1.0:1769074936.821836:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24956:1855007626650880:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074936.821858:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2e00/0x557988ac98fedb3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca3e expref: 235 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.821869:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2e00, rc 0) 00000100:00100000:1.0:1769074936.821914:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:67995:x1855007616254208:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6896us (7390us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074936.821923:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2884 00000100:00100000:2.0:1769074936.833345:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1855007626651008:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074936.833374:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074936.833490:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2420:x1855007616254336:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 12413us (12642us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074936.833502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1968 00000100:00100000:3.0:1769074936.837129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.837256:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254592 00000100:00100000:1.0:1769074936.837272:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254592 00000100:00100000:1.0:1769074936.837342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1953 00000100:00100000:1.0:1769074936.837352:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+427:67995:x1855007616254592:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074936.837714:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:67995:x1855007616254592:12345-192.168.204.32@tcp:35:cp.0 Request processed in 362us (607us total) trans 4294969195 rc 0/0 00000100:00100000:1.0:1769074936.837722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1953 00000100:00100000:0.0:1769074936.910846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074936.913701:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254720 00000100:00100000:3.0:1769074936.913728:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254720 00000100:00100000:3.0:1769074936.913834:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 321 00000100:00100000:3.0:1769074936.913847:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2417:x1855007616254720:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074936.913929:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074936.913971:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedb44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca45 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.914053:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074936.914073:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914089:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914105:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074936.914125:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914134:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914215:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914224:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914232:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914239:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.914244:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914254:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914269:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.914273:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.914279:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914286:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedb4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914304:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914311:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914316:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914321:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074936.914324:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914333:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914341:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604e58c100) 00010000:00010000:3.0:1769074936.914345:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074936.914348:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914355:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedb52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074936.914392:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedb44 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca45 expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.914418:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074936.914421:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074936.914426:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedb44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca45 expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074936.914437:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423200, rc -2) 00000100:00100000:3.0:1769074936.914614:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2417:x1855007616254720:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 769us (3779us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074936.914624:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 321 00000100:00100000:2.0:1769074936.939175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.939280:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254848 00000100:00100000:1.0:1769074936.939290:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254848 00000100:00100000:1.0:1769074936.939352:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9914 00000100:00100000:1.0:1769074936.939363:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68002:x1855007616254848:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1769074936.939400:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.939423:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb59 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca7d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.939493:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.939508:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939518:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939564:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.939572:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939590:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939642:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939650:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939656:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939663:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.939667:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939674:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939685:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.939688:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.939693:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939699:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedb60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939711:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939716:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939721:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939726:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.939729:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939734:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.939741:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff916052aa4900) 00010000:00010000:1.0:1769074936.940045:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.940051:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.940058:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.940095:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb59 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca7d expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.940106:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.940109:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.940113:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb59 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca7d expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.940122:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074936.940193:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68002:x1855007616254848:12345-192.168.204.32@tcp:101:bash.0 Request processed in 831us (1027us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.940200:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9914 00000100:00100000:0.0:1769074936.956219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074936.956476:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616254976 00000100:00100000:2.0:1769074936.956488:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616254976 00000100:00100000:2.0:1769074936.956567:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9915 00000100:00100000:2.0:1769074936.956586:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68003:x1855007616254976:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074936.956605:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1769074936.956617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1769074936.956627:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedb6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.956695:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.956709:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956719:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956733:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074936.956739:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956757:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956821:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956834:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956839:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956846:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956851:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.956854:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956861:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956872:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.956875:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.956879:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956884:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedb75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956897:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956903:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956908:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956913:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074936.956917:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956921:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956928:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff91604ec89800) 00010000:00010000:2.0:1769074936.956930:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.956933:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.956938:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedb7c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074936.957351:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedb6e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca84 expref: 429 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.957363:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074936.957376:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074936.957381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedb6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca84 expref: 429 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074936.957391:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ee00, rc 0) 00000100:00100000:2.0:1769074936.957459:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68003:x1855007616254976:12345-192.168.204.32@tcp:101:rm.0 Request processed in 883us (1251us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074936.957467:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9915 00000100:00100000:0.0:1769074936.957901:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255104 00000100:00100000:0.0:1769074936.957908:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255104 00000100:00100000:0.0:1769074936.957961:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 322 00000100:00100000:0.0:1769074936.957978:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2419:x1855007616255104:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074936.958005:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074936.958018:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedb83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca8b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.958058:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074936.958070:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958078:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958091:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074936.958109:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958115:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958155:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958162:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958167:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958173:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.958176:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958182:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958191:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.958194:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.958197:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958202:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedb8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958211:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958217:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958221:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958225:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074936.958228:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958233:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958239:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x87c92ea6 (ffff91604f1adf00) 00010000:00010000:0.0:1769074936.958241:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074936.958244:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958250:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedb91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x87c92ea6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074936.958271:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedb83 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca8b expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.958279:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074936.958281:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074936.958284:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedb83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca8b expref: 429 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074936.958293:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1eee00, rc -2) 00000100:00100000:0.0:1769074936.958340:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:2419:x1855007616255104:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 371us (1722us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074936.958347:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 322 00000100:00100000:3.0:1769074936.970356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.970465:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255232 00000100:00100000:1.0:1769074936.970476:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255232 00000100:00100000:1.0:1769074936.970566:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9916 00000100:00100000:1.0:1769074936.970721:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68003:x1855007616255232:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1769074936.970755:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.970778:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb98 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca92 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.970849:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.970864:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.970877:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.970890:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.970896:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.970903:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.970962:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971136:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971143:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971150:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.971154:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971162:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971174:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.971177:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.971181:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971187:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedb9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971201:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971207:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971212:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971216:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.971219:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971223:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971230:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff916052aa4900) 00010000:00010000:1.0:1769074936.971232:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.971234:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971239:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedba6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.971271:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb98 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca92 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.971280:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.971283:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.971287:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedb98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca92 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.971300:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074936.971366:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68003:x1855007616255232:12345-192.168.204.32@tcp:101:rm.0 Request processed in 791us (1019us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.971373:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9916 00000100:00100000:3.0:1769074936.995227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074936.995407:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255360 00000100:00100000:1.0:1769074936.995418:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255360 00000100:00100000:1.0:1769074936.995481:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9917 00000100:00100000:1.0:1769074936.995491:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68004:x1855007616255360:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074936.995510:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074936.995570:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ca99 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.995657:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.995671:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995682:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995698:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074936.995704:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995710:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995766:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995774:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995780:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995785:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.995790:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995797:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995808:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.995811:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.995816:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995822:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995835:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995841:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995846:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995851:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074936.995855:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995860:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995867:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff916052aa4900) 00010000:00010000:1.0:1769074936.995869:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.995872:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995877:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074936.995907:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca99 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.995917:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074936.995919:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074936.995922:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ca99 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074936.995931:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074936.996010:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68004:x1855007616255360:12345-192.168.204.32@tcp:101:cp.0 Request processed in 520us (790us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074936.996017:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9917 00000100:00100000:0.0:1769074937.015146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.015237:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255488 00000100:00100000:1.0:1769074937.015248:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255488 00000100:00100000:1.0:1769074937.015320:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9918 00000100:00100000:1.0:1769074937.015331:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68004:x1855007616255488:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074937.015354:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.015386:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbc2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2caa0 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.015453:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074937.015469:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015479:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015493:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:1.0:1769074937.015500:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015506:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000100:00080000:0.0:1769074937.015683:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1769074937.015738:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015746:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015753:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015759:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074937.015764:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015775:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015787:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074937.015790:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074937.015795:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015801:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedbc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015814:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015819:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015825:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015830:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074937.015832:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015837:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.015844:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff916052aa4900) 00010000:00010000:2.0:1769074937.021475:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769074937.026291:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074937.026314:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.026327:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3000/0x557988ac98fedbd0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074937.026392:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbc2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caa0 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.026406:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074937.026409:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074937.026413:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caa0 expref: 429 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.026422:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074937.026556:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68004:x1855007616255488:12345-192.168.204.32@tcp:101:cp.0 Request processed in 11226us (11418us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074937.027706:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9918 00000100:00100000:3.0:1769074937.029419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.029516:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255744 00000100:00100000:0.0:1769074937.029576:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255744 00000100:00100000:0.0:1769074937.029634:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9919 00000100:00100000:0.0:1769074937.029643:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+428:68004:x1855007616255744:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074937.029664:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.029684:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedbd7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2caa7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.029811:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074937.029832:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.029844:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.029859:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074937.029866:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.029872:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:0.0:1769074937.030759:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xdf:0x0], index 1: 0 00010000:00010000:0.0:1769074937.030930:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fedbec lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074937.030944:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fedbec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.030964:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fedbec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.030998:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031005:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031012:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031022:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.031026:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031035:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031048:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.031051:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.031055:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031061:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedbde lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:0.0:1769074937.031073:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000018fb9a5a reply state 00000000fdea1828 transno 4294969196 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031083:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.031089:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff91604f1adf00) 00010000:00010000:0.0:1769074937.031092:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1769074937.031095:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1769074937.031794:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedbd7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caa7 expref: 431 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.031813:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1efa00/0x557988ac98fedbec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caa7 expref: 430 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.031821:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c7:0x0].0x0 (ffff91604f1ade00) 00010000:00010000:0.0:1769074937.031824:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1769074937.031827:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1efa00, rc 0) 00000100:00100000:0.0:1769074937.031944:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:68004:x1855007616255744:12345-192.168.204.32@tcp:101:cp.0 Request processed in 2300us (2531us total) trans 4294969196 rc 0/0 00000100:00100000:0.0:1769074937.031962:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9919 00000100:00100000:3.0:1769074937.044735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.045938:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616255872 00000100:00100000:1.0:1769074937.045961:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616255872 00000100:00100000:1.0:1769074937.046054:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2885 00000100:00100000:1.0:1769074937.046065:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616255872:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074937.046086:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.046107:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2caae expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1769074937.046248:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1769074937.046425:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074937.046445:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.046448:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.046457:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 225 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.046476:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 225 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.046490:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc 0) 00000100:00100000:1.0:1769074937.046724:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2417:x1855007616255872:12345-192.168.204.32@tcp:101:cp.0 Request processed in 659us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074937.046733:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2885 00000100:00100000:3.0:1769074937.050709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.053948:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256000 00000100:00100000:2.0:1769074937.054105:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256000 00000100:00100000:2.0:1769074937.054298:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2886 00000100:00100000:2.0:1769074937.054309:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:68004:x1855007616256000:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.054327:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.054344:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cab5 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.054375:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.054383:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.054385:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.054390:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cab5 expref: 226 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.054428:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.054442:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:2.0:1769074937.054455:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626651136:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074937.054586:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff916150315d80 going to sleep for 11 seconds 00000100:00100000:2.0:1769074937.057202:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626651136:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074937.057239:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cab5 expref: 226 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.057260:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9ee00, rc 0) 00000100:00100000:2.0:1769074937.057316:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:68004:x1855007616256000:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3008us (6615us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.057325:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2886 00000100:00100000:3.0:1769074937.059347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.059443:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256128 00000100:00100000:2.0:1769074937.059453:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256128 00010000:00010000:2.0:1769074937.059506:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:3.0:1769074937.059644:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1969 00000100:00100000:3.0:1769074937.059657:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616256128:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074937.059672:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074937.059693:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.059708:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.059730:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d3200/0x557988ac98fedbfa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caae expref: 226 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.059746:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074937.059748:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074937.059755:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cab5 expref: 225 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.059765:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cab5 expref: 225 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.059800:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604ea9ee00/0x557988ac98fedc01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cab5 expref: 225 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074937.059814:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604369c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626651264:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074937.059943:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604f4a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074937.073900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.073997:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256384 00000100:00100000:2.0:1769074937.074007:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256384 00000100:00100000:2.0:1769074937.074068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1954 00000100:00100000:2.0:1769074937.074078:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+431:68004:x1855007616256384:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074937.074350:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68004:x1855007616256384:12345-192.168.204.32@tcp:35:cp.0 Request processed in 273us (460us total) trans 4294969197 rc 0/0 00000100:00100000:2.0:1769074937.074357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1954 00000100:00100000:3.0:1769074937.075277:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604369c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626651264:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074937.075306:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1769074937.075340:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616256128:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 15687us (16001us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074937.075348:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1969 00000100:00100000:0.0:1769074937.099379:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.099444:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256512 00000100:00100000:2.0:1769074937.099453:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256512 00000100:00100000:2.0:1769074937.099499:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 323 00000100:00100000:2.0:1769074937.099505:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:2420:x1855007616256512:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074937.104328:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.104357:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc08 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cabc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.104417:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074937.104431:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104441:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104455:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074937.104460:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104466:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104517:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104524:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104823:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104831:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.104835:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104842:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104855:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.104857:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.104862:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104868:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104882:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104887:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104892:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104896:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.104898:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104903:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104908:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89800) 00010000:00010000:2.0:1769074937.104910:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.104912:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104916:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074937.104946:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc08 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cabc expref: 433 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.104966:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.104969:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074937.104973:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc08 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cabc expref: 433 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.104981:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc -2) 00000100:00100000:2.0:1769074937.105218:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:2420:x1855007616256512:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 5710us (5844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074937.105229:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 323 00000100:00100000:3.0:1769074937.128437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.128921:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256640 00000100:00100000:0.0:1769074937.128936:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256640 00000100:00100000:0.0:1769074937.129032:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9920 00000100:00100000:0.0:1769074937.129041:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68010:x1855007616256640:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1769074937.129058:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.129077:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedc1d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2caf4 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.129138:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074937.129151:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129162:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129175:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:0.0:1769074937.129181:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129186:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000100:00080000:3.0:1769074937.129421:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1769074937.129565:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129572:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129578:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129584:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eee00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.129587:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129594:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129606:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.129609:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.129614:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129619:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eee00/0x557988ac98fedc24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129631:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129636:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129642:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129647:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.129649:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129654:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129661:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.129664:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.129667:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129672:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc2b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:0.0:1769074937.129703:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedc1d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caf4 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.129712:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.129714:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.129717:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef600/0x557988ac98fedc1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2caf4 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.129725:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f1ef600, rc 0) 00000100:00100000:2.0:1769074937.134392:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68010:x1855007616256640:12345-192.168.204.32@tcp:101:bash.0 Request processed in 5338us (5957us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.134406:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9920 00000100:00100000:1.0:1769074937.163036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.163148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.163223:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256896 00000100:00100000:0.0:1769074937.163232:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256896 00000100:00100000:0.0:1769074937.163295:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 324 00000100:00100000:0.0:1769074937.163305:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:2417:x1855007616256896:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074937.163339:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.163360:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb02 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.163421:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074937.163435:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163446:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163461:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074937.163469:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163475:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163521:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163556:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163563:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163569:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.163573:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163581:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163596:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.163600:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.163604:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163610:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedc39 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163623:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163629:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163634:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163639:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.163642:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163648:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163654:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a89a5f9 (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.163656:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.163659:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163664:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a89a5f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074937.163688:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc32 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb02 expref: 433 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.163698:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.163701:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074937.163705:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb02 expref: 433 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.163713:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa000, rc -2) 00000100:00100000:0.0:1769074937.163783:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:2417:x1855007616256896:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 479us (633us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074937.163791:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 324 00000100:00100000:2.0:1769074937.164219:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616256768 00000100:00100000:2.0:1769074937.164226:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616256768 00000100:00100000:2.0:1769074937.164305:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9921 00000100:00100000:2.0:1769074937.164313:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68011:x1855007616256768:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.164324:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.164336:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cafb expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.164378:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.164388:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164397:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164423:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.164430:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164436:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164466:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164473:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164479:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164484:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.164489:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164494:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164502:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.164505:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.164508:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164514:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164525:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164562:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164568:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164573:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.164575:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164585:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164592:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604ec89800) 00010000:00010000:2.0:1769074937.164594:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.164597:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164602:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc55 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.164627:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc47 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cafb expref: 433 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.164636:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.164638:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.164642:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cafb expref: 433 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.164650:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074937.164693:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68011:x1855007616256768:12345-192.168.204.32@tcp:101:rm.0 Request processed in 382us (1667us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.164700:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9921 00000100:00100000:1.0:1769074937.175152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.175232:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257024 00000100:00100000:2.0:1769074937.175244:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257024 00000100:00100000:2.0:1769074937.175308:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9922 00000100:00100000:2.0:1769074937.175318:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68011:x1855007616257024:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.175337:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.175361:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb09 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.175436:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.175451:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175461:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175474:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.175480:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175492:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175585:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175602:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175608:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175614:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.175617:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175624:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175636:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.175639:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.175644:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175649:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175663:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175668:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175673:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175678:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.175680:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175686:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175692:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604ec89800) 00010000:00010000:2.0:1769074937.175694:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.175696:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175701:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.175732:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc5c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb09 expref: 433 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.175743:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.175745:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.175749:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb09 expref: 433 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.175758:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074937.175823:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68011:x1855007616257024:12345-192.168.204.32@tcp:101:rm.0 Request processed in 507us (682us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.175831:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9922 00000100:00100000:1.0:1769074937.227202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.227314:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257152 00000100:00100000:0.0:1769074937.227323:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257152 00000100:00100000:0.0:1769074937.227391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9923 00000100:00100000:0.0:1769074937.227401:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68012:x1855007616257152:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074937.227421:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.227443:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.227509:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1769074937.227524:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1769074937.227882:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.227995:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.228005:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228013:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228063:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228070:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228075:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228082:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228088:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.228092:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228099:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228114:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.228117:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.228122:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fedc78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228141:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228147:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228152:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228157:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.228159:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228164:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228170:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.228172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.228175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228179:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedc7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.228213:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc71 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb10 expref: 433 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.228222:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.228224:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.228227:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedc71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb10 expref: 433 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.228236:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa000, rc 0) 00000100:00100000:3.0:1769074937.228339:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68012:x1855007616257152:12345-192.168.204.32@tcp:101:cp.0 Request processed in 939us (1146us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.228348:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9923 00000100:00100000:3.0:1769074937.237648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.237771:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257280 00000100:00100000:2.0:1769074937.237783:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257280 00000100:00100000:2.0:1769074937.237876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9924 00000100:00100000:2.0:1769074937.237887:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68012:x1855007616257280:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.237907:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.237928:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb17 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.238009:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.238024:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238034:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238047:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.238058:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238063:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238128:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238136:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238141:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238147:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238153:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.238157:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238164:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238175:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.238178:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.238182:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedc8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238213:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238218:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238223:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238228:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.238231:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238236:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604ec89800) 00010000:00010000:2.0:1769074937.238246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.238248:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238253:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedc94 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.238282:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc86 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb17 expref: 433 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.238292:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.238294:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.238298:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb17 expref: 433 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.238306:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074937.238374:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68012:x1855007616257280:12345-192.168.204.32@tcp:101:cp.0 Request processed in 488us (735us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.238382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9924 00000100:00100000:1.0:1769074937.253370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.253614:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257536 00000100:00100000:2.0:1769074937.253623:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257536 00000100:00100000:2.0:1769074937.253675:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9925 00000100:00100000:2.0:1769074937.253682:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+432:68012:x1855007616257536:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.253698:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.253716:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc9b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.253826:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.253841:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.253852:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.253866:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.253873:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.253877:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074937.254351:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xdf:0x0], index 0: 0 00010000:00010000:2.0:1769074937.254571:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fedcb0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.254583:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fedcb0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254594:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fedcb0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254634:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254644:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254652:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254658:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254666:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.254670:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254680:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254696:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.254700:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.254704:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254713:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedca2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074937.254731:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001973396d reply state 000000000f8d11d3 transno 4294969198 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254741:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.254748:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604ec89800) 00010000:00010000:2.0:1769074937.254750:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.254755:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.254788:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedc9b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb1e expref: 435 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.254801:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9fe00/0x557988ac98fedcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb1e expref: 434 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.254808:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c8:0x0].0x0 (ffff91604ec89a00) 00010000:00010000:2.0:1769074937.254810:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.254813:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9fe00, rc 0) 00000100:00100000:2.0:1769074937.254957:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:68012:x1855007616257536:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1265us (1585us total) trans 4294969198 rc 0/0 00000100:00100000:2.0:1769074937.254969:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9925 00000100:00100000:1.0:1769074937.261354:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.261422:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257664 00000100:00100000:2.0:1769074937.261432:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257664 00000100:00100000:2.0:1769074937.261503:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2887 00000100:00100000:2.0:1769074937.261512:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2420:x1855007616257664:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.261568:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.261587:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb25 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074937.261611:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074937.261628:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.261630:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.261637:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 235 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.261654:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 235 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.261666:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074937.261715:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2420:x1855007616257664:12345-192.168.204.32@tcp:101:cp.0 Request processed in 204us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.261721:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2887 00000100:00080000:0.0:1769074937.261923:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769074937.265492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.265688:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257792 00000100:00100000:1.0:1769074937.265699:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257792 00000100:00100000:1.0:1769074937.265761:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2888 00000100:00100000:1.0:1769074937.265771:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:68012:x1855007616257792:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074937.265788:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.265807:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb2c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.265838:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.265846:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.265848:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.265853:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb2c expref: 236 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.265890:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.265903:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:1.0:1769074937.265917:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626651392:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074937.266028:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074937.273035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.275306:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626651392:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074937.275345:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb2c expref: 236 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.275365:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3000, rc 0) 00000100:00100000:0.0:1769074937.276297:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:68012:x1855007616257792:12345-192.168.204.32@tcp:101:cp.0 Request processed in 10519us (10807us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.276309:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2888 00000100:00100000:3.0:1769074937.276588:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616257920 00000100:00100000:3.0:1769074937.276605:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616257920 00010000:00010000:3.0:1769074937.276660:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:3.0:1769074937.276698:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1970 00000100:00100000:3.0:1769074937.276708:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2419:x1855007616257920:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1769074937.276723:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1769074937.276747:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.276762:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.276787:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604ea9f000/0x557988ac98fedcbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0xdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb25 expref: 236 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:3.0:1769074937.276803:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074937.276805:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1769074937.276812:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb2c expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.276823:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb2c expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.276862:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d3000/0x557988ac98fedcc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb2c expref: 235 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1769074937.276877:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626651520:192.168.204.32@tcp:105: 00000100:00100000:3.0:1769074937.276941:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604f4a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1769074937.283239:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.283333:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258176 00000100:00100000:1.0:1769074937.283344:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258176 00000100:00100000:1.0:1769074937.283404:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1955 00000100:00100000:1.0:1769074937.283413:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+435:68012:x1855007616258176:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074937.283776:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68012:x1855007616258176:12345-192.168.204.32@tcp:35:cp.0 Request processed in 362us (546us total) trans 4294969199 rc 0/0 00000100:00100000:1.0:1769074937.283784:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1955 00000100:00100000:3.0:1769074937.286052:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626651520:192.168.204.32@tcp:105: 00010000:00010000:3.0:1769074937.286084:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074937.287489:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2419:x1855007616257920:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 10773us (14454us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.287512:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1970 00000100:00100000:0.0:1769074937.320845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.320957:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258304 00000100:00100000:1.0:1769074937.320968:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258304 00000100:00100000:1.0:1769074937.321033:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 325 00000100:00100000:1.0:1769074937.321043:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:2419:x1855007616258304:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:1.0:1769074937.321129:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.321152:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedccc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb33 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.321219:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074937.321233:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321244:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321257:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:1.0:1769074937.321264:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321270:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321320:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321327:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321333:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321340:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074937.321344:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321355:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321366:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074937.321369:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074937.321373:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321379:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2800/0x557988ac98fedcd3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321392:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321399:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321405:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321411:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074937.321414:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321420:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321427:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff916052aa4e00) 00010000:00010000:1.0:1769074937.321429:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074937.321433:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321438:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedcda lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:1.0:1769074937.321465:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedccc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb33 expref: 437 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.321475:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074937.321477:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1769074937.321481:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fedccc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb33 expref: 437 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.322080:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d3200, rc -2) 00000100:00100000:2.0:1769074937.322999:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:2419:x1855007616258304:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1950us (2157us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074937.323011:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 325 00000100:00100000:0.0:1769074937.344462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.344703:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258432 00000100:00100000:3.0:1769074937.344713:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258432 00000100:00100000:3.0:1769074937.344769:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9926 00000100:00100000:3.0:1769074937.344778:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68017:x1855007616258432:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074937.344798:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.344817:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedce1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb6b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.344878:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.344896:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.344906:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.344918:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.344924:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.344930:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345010:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345017:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345023:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345029:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.345033:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345040:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345050:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.345053:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.345058:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345064:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedce8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345076:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345082:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345087:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345092:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.345094:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345099:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345113:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604e58c100) 00010000:00010000:3.0:1769074937.345116:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.345118:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345123:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedcef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.345148:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedce1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb6b expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.345156:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.345159:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.345163:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedce1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb6b expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.345170:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423200, rc 0) 00000100:00100000:3.0:1769074937.345225:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68017:x1855007616258432:12345-192.168.204.32@tcp:101:bash.0 Request processed in 448us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.345231:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9926 00000100:00100000:0.0:1769074937.360892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.361021:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258560 00000100:00100000:2.0:1769074937.361033:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258560 00000100:00100000:2.0:1769074937.361096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9927 00000100:00100000:2.0:1769074937.361116:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68018:x1855007616258560:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.361135:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.361156:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedcf6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb72 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.361219:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.361235:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361246:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361284:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.361292:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361298:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361350:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361357:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361363:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361369:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361375:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.361379:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361386:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361398:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.361401:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.361406:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361412:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fedcfd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361425:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361430:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361436:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361441:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.361443:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361448:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361454:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89f00) 00010000:00010000:2.0:1769074937.361457:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.361459:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361465:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd04 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.361509:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedcf6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb72 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.361518:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.361521:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.361525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fedcf6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb72 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.361818:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9e800, rc 0) 00000100:00100000:2.0:1769074937.362007:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68018:x1855007616258560:12345-192.168.204.32@tcp:101:rm.0 Request processed in 901us (1123us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.362014:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9927 00000100:00100000:2.0:1769074937.371409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.371807:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258688 00000100:00100000:0.0:1769074937.371820:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258688 00000100:00100000:0.0:1769074937.371883:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 326 00000100:00100000:0.0:1769074937.371893:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:2418:x1855007616258688:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074937.371933:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.371964:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fedd0b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb79 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.372853:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.372870:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.372883:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.372899:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.372906:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.372916:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373217:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373225:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373233:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373239:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.373243:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373250:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373262:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.373265:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.373269:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373274:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fedd12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373287:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373293:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373298:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373304:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.373306:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373312:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373318:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x880ce35a (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.373320:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.373323:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373328:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fedd19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.373358:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fedd0b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb79 expref: 437 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.373366:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.373368:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074937.373371:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fba00/0x557988ac98fedd0b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb79 expref: 437 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.373380:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fba00, rc -2) 00000100:00100000:0.0:1769074937.373461:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:2418:x1855007616258688:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1570us (2062us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074937.373470:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 326 00000100:00100000:1.0:1769074937.381458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.381829:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258816 00000100:00100000:2.0:1769074937.381840:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258816 00000100:00100000:2.0:1769074937.381905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9928 00000100:00100000:2.0:1769074937.381915:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68018:x1855007616258816:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.381935:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.382340:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd20 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb80 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.382417:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.382433:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382445:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382460:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.382467:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382477:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382595:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382603:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382608:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382614:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382620:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.382624:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382631:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382644:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.382648:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.382652:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382659:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd27 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382673:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382679:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382685:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382690:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.382693:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382699:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382705:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89f00) 00010000:00010000:2.0:1769074937.382708:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.382711:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382716:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd2e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.382749:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd20 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb80 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.382762:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.382764:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.382768:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd20 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb80 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.382777:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b800, rc 0) 00000100:00100000:2.0:1769074937.382928:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68018:x1855007616258816:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1014us (1478us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.382936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9928 00000100:00100000:1.0:1769074937.401750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.401853:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616258944 00000100:00100000:2.0:1769074937.401865:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616258944 00000100:00100000:2.0:1769074937.401921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9929 00000100:00100000:2.0:1769074937.401931:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68019:x1855007616258944:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.401959:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.401981:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd35 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.402044:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.402058:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402070:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402085:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.402091:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402097:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402158:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402166:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402173:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402185:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402190:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.402194:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402202:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402213:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.402215:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.402220:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402225:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402239:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402245:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402251:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402256:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.402258:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402264:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89f00) 00010000:00010000:2.0:1769074937.402276:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.402279:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402284:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd43 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.402316:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd35 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb87 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.402327:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.402330:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.402333:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd35 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb87 expref: 437 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.402342:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b800, rc 0) 00000100:00100000:2.0:1769074937.402402:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68019:x1855007616258944:12345-192.168.204.32@tcp:101:cp.0 Request processed in 473us (662us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.402410:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9929 00000100:00100000:2.0:1769074937.414835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.415028:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259072 00000100:00100000:3.0:1769074937.415042:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259072 00000100:00100000:3.0:1769074937.415111:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9930 00000100:00100000:3.0:1769074937.415121:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68019:x1855007616259072:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074937.415143:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.415164:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedd4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb8e expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.415231:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.415246:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415257:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415272:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.415279:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415284:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415334:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415340:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415346:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415351:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.415355:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415362:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415373:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.415376:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.415380:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415386:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedd51 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415399:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415405:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415411:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415416:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.415419:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415424:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415431:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604e58c100) 00010000:00010000:3.0:1769074937.415433:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.415436:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415441:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedd58 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.415471:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedd4a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb8e expref: 437 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.415481:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.415483:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.415486:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedd4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb8e expref: 437 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.415508:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423200, rc 0) 00000100:00100000:0.0:1769074937.415956:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68019:x1855007616259072:12345-192.168.204.32@tcp:101:cp.0 Request processed in 825us (1121us total) trans 0 rc 301/301 00000100:00100000:0.0:1769074937.415970:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9930 00000100:00100000:1.0:1769074937.422897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.423002:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259328 00000100:00100000:2.0:1769074937.423013:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259328 00000100:00100000:2.0:1769074937.423070:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9931 00000100:00100000:2.0:1769074937.423080:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+436:68019:x1855007616259328:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.423100:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.423128:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd5f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.423246:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.423262:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.423273:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.423286:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.423293:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.423299:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074937.423804:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xe0:0x0], index 1: 0 00010000:00010000:2.0:1769074937.423982:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a400/0x557988ac98fedd74 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.423995:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a400/0x557988ac98fedd74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424003:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a400/0x557988ac98fedd74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424038:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424044:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424053:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424060:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424066:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.424070:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424076:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424089:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.424091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.424094:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424100:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd66 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074937.424114:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000591db350 reply state 000000004cac38c6 transno 4294969200 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424123:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.424128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89f00) 00010000:00010000:2.0:1769074937.424130:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.424132:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.424160:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd5f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb95 expref: 439 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.424177:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a400/0x557988ac98fedd74 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb95 expref: 438 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.424184:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1c9:0x0].0x0 (ffff91604ec89000) 00010000:00010000:2.0:1769074937.424186:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.424189:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a400, rc 0) 00000100:00100000:2.0:1769074937.424267:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:68019:x1855007616259328:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1187us (1381us total) trans 4294969200 rc 0/0 00000100:00100000:2.0:1769074937.424275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9931 00000100:00100000:1.0:1769074937.430513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.430792:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259456 00000100:00100000:2.0:1769074937.430802:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259456 00000100:00100000:2.0:1769074937.430863:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2889 00000100:00100000:2.0:1769074937.430874:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616259456:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.430892:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.430913:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cb9c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074937.430938:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074937.430978:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.430981:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.430990:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 226 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.431007:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 226 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.431025:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.431090:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616259456:12345-192.168.204.32@tcp:101:cp.0 Request processed in 217us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.431097:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2889 00000100:00100000:3.0:1769074937.434838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.435253:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259584 00000100:00100000:1.0:1769074937.435263:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259584 00000100:00100000:1.0:1769074937.435322:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2890 00000100:00100000:1.0:1769074937.435332:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:68019:x1855007616259584:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074937.435349:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.435367:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cba3 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.435399:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.435408:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.435410:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.435414:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cba3 expref: 227 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.435450:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.435464:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 2026 lvb_type: 1 00000100:00100000:1.0:1769074937.435479:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044ce7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626651648:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074937.435627:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1769074937.442075:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044ce7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626651648:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074937.442125:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cba3 expref: 227 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074937.442143:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2800, rc 0) 00000100:00100000:1.0:1769074937.442214:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:68019:x1855007616259584:12345-192.168.204.32@tcp:101:cp.0 Request processed in 6881us (7383us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074937.442224:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2890 00000100:00100000:3.0:1769074937.443437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.443855:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259712 00000100:00100000:2.0:1769074937.443866:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259712 00010000:00010000:2.0:1769074937.443929:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 2026 lvb_type: 1 00000100:00100000:2.0:1769074937.443991:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1971 00000100:00100000:2.0:1769074937.444000:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2420:x1855007616259712:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074937.444016:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074937.444039:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 2026 lvb_type: 1 00010000:00010000:2.0:1769074937.444054:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 2026 lvb_type: 1 00010000:00010000:2.0:1769074937.444078:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd82 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cb9c expref: 227 pid: 8405 timeout: 2026 lvb_type: 1 00010000:00010000:2.0:1769074937.444107:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.444109:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.444117:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cba3 expref: 226 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.444133:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cba3 expref: 226 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.444170:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f3d2800/0x557988ac98fedd89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cba3 expref: 226 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074937.444183:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626651776:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074937.444265:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916160ecec00 going to sleep for 11 seconds 00000100:00100000:2.0:1769074937.452265:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626651776:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074937.452294:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074937.452365:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616259712:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 8366us (8933us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.452377:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1971 00000100:00100000:3.0:1769074937.454674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.454827:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616259968 00000100:00100000:2.0:1769074937.454839:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616259968 00000100:00100000:2.0:1769074937.454895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1956 00000100:00100000:2.0:1769074937.454904:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+439:68019:x1855007616259968:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074937.455205:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68019:x1855007616259968:12345-192.168.204.32@tcp:35:cp.0 Request processed in 300us (539us total) trans 4294969201 rc 0/0 00000100:00100000:2.0:1769074937.455213:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1956 00000100:00100000:0.0:1769074937.501805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.502165:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260096 00000100:00100000:2.0:1769074937.502176:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260096 00000100:00100000:2.0:1769074937.502232:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9932 00000100:00100000:2.0:1769074937.502243:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68022:x1855007616260096:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074937.502266:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.502291:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd90 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbaa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.502361:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.502376:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502389:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502407:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.502414:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502420:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502480:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502489:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502497:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502503:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502510:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.502515:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502523:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502590:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.502594:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.502599:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502606:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedd97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502621:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502627:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502632:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502635:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.502637:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502642:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502648:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89900) 00010000:00010000:2.0:1769074937.502651:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.502654:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502664:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedd9e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.502696:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd90 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbaa expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.502705:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.502707:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.502710:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedd90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbaa expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.502718:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.502791:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68022:x1855007616260096:12345-192.168.204.32@tcp:101:bash.0 Request processed in 550us (996us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.502798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9932 00000100:00100000:0.0:1769074937.519227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.519318:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260224 00000100:00100000:2.0:1769074937.519328:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260224 00000100:00100000:2.0:1769074937.519386:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9933 00000100:00100000:2.0:1769074937.519395:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68023:x1855007616260224:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.519420:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.519440:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedda5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbb1 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.519517:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.519561:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519576:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519589:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.519595:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519602:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519659:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519667:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519673:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519679:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.519683:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519690:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519701:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.519704:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.519708:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519714:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519726:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519731:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519736:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519741:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.519743:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519748:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519755:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89900) 00010000:00010000:2.0:1769074937.519758:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.519760:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519766:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddb3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.519795:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedda5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbb1 expref: 441 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.519804:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.519806:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.519809:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedda5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbb1 expref: 441 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.519822:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.519877:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68023:x1855007616260224:12345-192.168.204.32@tcp:101:rm.0 Request processed in 482us (661us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.519884:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9933 00000100:00100000:3.0:1769074937.524579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.524620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.524860:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260352 00000100:00100000:2.0:1769074937.524871:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260352 00000100:00100000:2.0:1769074937.524925:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9934 00000100:00100000:2.0:1769074937.524934:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68023:x1855007616260352:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.524963:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.524982:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98feddba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbb8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.525045:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.525059:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525069:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525083:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.525090:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525095:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525158:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525165:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525171:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525177:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525182:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.525187:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525195:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525205:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.525208:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.525212:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525218:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddc1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525229:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525234:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525240:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525245:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.525248:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525254:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525260:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89900) 00010000:00010000:2.0:1769074937.525263:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.525265:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525270:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddc8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.525298:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98feddba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbb8 expref: 441 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.525308:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.525310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.525314:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98feddba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbb8 expref: 441 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.525323:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.525376:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68023:x1855007616260352:12345-192.168.204.32@tcp:101:rm.0 Request processed in 442us (849us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.525384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9934 00000100:00100000:0.0:1769074937.525750:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260480 00000100:00100000:0.0:1769074937.525756:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260480 00000100:00100000:0.0:1769074937.525794:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 327 00000100:00100000:0.0:1769074937.525801:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:2418:x1855007616260480:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074937.525823:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.525834:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98feddcf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbbf expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.525865:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.525874:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525882:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525894:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.525900:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525905:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525936:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525957:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525963:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525968:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.525971:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525976:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525984:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.525986:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.525989:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.525994:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98feddd6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526004:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526008:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526013:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526018:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.526020:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526028:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526034:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xed78eb5 (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.526036:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.526039:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526043:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fedddd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.526062:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98feddcf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbbf expref: 441 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.526069:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.526072:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074937.526075:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98feddcf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbbf expref: 441 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.526083:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa600, rc -2) 00000100:00100000:0.0:1769074937.526129:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:2418:x1855007616260480:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 328us (1508us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074937.526135:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 327 00000100:00100000:3.0:1769074937.553306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.553482:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260608 00000100:00100000:2.0:1769074937.553503:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260608 00000100:00100000:2.0:1769074937.553604:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9935 00000100:00100000:2.0:1769074937.553615:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68024:x1855007616260608:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.553639:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.553664:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedde4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbc6 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.553740:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.553756:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553766:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553779:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.553787:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553792:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553852:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553860:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553866:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553872:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.553877:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553885:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553897:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.553900:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.553905:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553911:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feddeb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553926:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553931:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553937:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553972:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.553976:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553983:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.553990:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89900) 00010000:00010000:2.0:1769074937.553993:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.553996:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.554005:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98feddf2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.554038:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedde4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbc6 expref: 441 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.554048:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.554050:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.554054:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fedde4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbc6 expref: 441 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.554063:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.554139:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68024:x1855007616260608:12345-192.168.204.32@tcp:101:cp.0 Request processed in 525us (844us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.554147:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9935 00000100:00100000:3.0:1769074937.556210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.556521:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260736 00000100:00100000:2.0:1769074937.556567:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260736 00000100:00100000:2.0:1769074937.556614:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 328 00000100:00100000:2.0:1769074937.556624:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:2420:x1855007616260736:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074937.556662:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.556683:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12aa00/0x557988ac98feddf9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbcd expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.556735:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074937.556748:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556762:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556776:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:2.0:1769074937.556783:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556788:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556840:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556846:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556852:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556857:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.556860:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556867:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556877:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.556879:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.556883:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556888:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556900:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556906:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556912:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556917:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.556919:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556924:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556929:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xed78eb5 (ffff91604ec89600) 00010000:00010000:2.0:1769074937.556931:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.556934:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556938:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:2.0:1769074937.556978:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12aa00/0x557988ac98feddf9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbcd expref: 441 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.556986:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.556988:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074937.556992:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12aa00/0x557988ac98feddf9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbcd expref: 441 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.557005:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12aa00, rc -2) 00000100:00100000:2.0:1769074937.557072:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:2420:x1855007616260736:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 448us (871us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074937.557080:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 328 00000100:00100000:1.0:1769074937.562950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.563028:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616260864 00000100:00100000:3.0:1769074937.563038:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616260864 00000100:00100000:3.0:1769074937.563093:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9936 00000100:00100000:3.0:1769074937.563107:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68024:x1855007616260864:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074937.563125:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.563144:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede0e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.563209:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.563225:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563234:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563248:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.563254:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563259:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563310:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563316:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563322:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563331:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563336:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.563340:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563346:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563357:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.563360:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.563364:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563369:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563382:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563388:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563393:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563398:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.563401:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563406:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.563419:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.563421:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563426:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fede1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.563457:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede0e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbd4 expref: 441 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.563467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.563470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.563473:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbd4 expref: 441 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.563483:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc 0) 00000100:00100000:3.0:1769074937.563600:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68024:x1855007616260864:12345-192.168.204.32@tcp:101:cp.0 Request processed in 497us (666us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.563607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9936 00000100:00100000:3.0:1769074937.568983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.569085:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261120 00000100:00100000:2.0:1769074937.569096:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261120 00000100:00100000:2.0:1769074937.569160:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9937 00000100:00100000:2.0:1769074937.569169:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+440:68024:x1855007616261120:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.569191:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.569213:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12aa00/0x557988ac98fede23 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbdb expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.569334:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.569349:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.569360:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.569374:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x703de786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.569380:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.569387:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074937.569868:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xe0:0x0], index 0: 0 00010000:00010000:2.0:1769074937.570037:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fede38 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.570049:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fede38 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570056:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fede38 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570088:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570095:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570102:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570108:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12be00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.570111:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570119:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570130:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.570133:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.570137:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570142:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede2a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074937.570160:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017af569c reply state 00000000ec1cbc18 transno 4294969202 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570172:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.570177:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89600) 00010000:00010000:2.0:1769074937.570179:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.570182:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.570214:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12aa00/0x557988ac98fede23 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbdb expref: 443 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.570229:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ac00/0x557988ac98fede38 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbdb expref: 442 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.570237:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ca:0x0].0x0 (ffff91604ec89900) 00010000:00010000:2.0:1769074937.570239:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.570242:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ac00, rc 0) 00000100:00100000:2.0:1769074937.570759:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:68024:x1855007616261120:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1588us (1782us total) trans 4294969202 rc 0/0 00000100:00100000:2.0:1769074937.570768:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9937 00000100:00100000:0.0:1769074937.576285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.576383:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261248 00000100:00100000:1.0:1769074937.576394:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261248 00000100:00100000:1.0:1769074937.576488:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2891 00000100:00100000:1.0:1769074937.576508:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2419:x1855007616261248:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074937.576527:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074937.576586:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbe2 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1769074937.576617:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1769074937.576638:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.576640:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074937.576650:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 236 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.576667:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 236 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074937.576680:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2400, rc 0) 00000100:00100000:1.0:1769074937.576892:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2419:x1855007616261248:12345-192.168.204.32@tcp:101:cp.0 Request processed in 385us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074937.576900:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2891 00000100:00100000:3.0:1769074937.580439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.580574:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261376 00000100:00100000:2.0:1769074937.580584:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261376 00000100:00100000:2.0:1769074937.580635:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2892 00000100:00100000:2.0:1769074937.580645:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:68024:x1855007616261376:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.580663:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.580682:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbe9 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.580721:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 237 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.580728:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.580730:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.580734:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe9 expref: 237 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.580770:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 237 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.580787:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 237 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:2.0:1769074937.580800:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626651904:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074937.580905:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052a5c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1769074937.584000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.584093:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261504 00000100:00100000:0.0:1769074937.584109:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261504 00010000:00010000:0.0:1769074937.584162:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 238 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:0.0:1769074937.584207:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1972 00000100:00100000:0.0:1769074937.584217:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91614c09f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616261504:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074937.584231:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074937.584251:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 238 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:0.0:1769074937.584266:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 238 pid: 24956 timeout: 2026 lvb_type: 1 00010000:00010000:0.0:1769074937.584291:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.584293:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.584300:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe9 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.584309:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe9 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.584342:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe9 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074937.584354:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626652032:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074937.584428:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6d80 going to sleep for 11 seconds 00010000:00010000:2.0:1769074937.585231:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f3d2400/0x557988ac98fede46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe2 expref: 238 pid: 24956 timeout: 2026 lvb_type: 1 00000100:00100000:2.0:1769074937.585247:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626651904:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074937.585272:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f12aa00/0x557988ac98fede4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbe9 expref: 237 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.585283:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12aa00, rc 0) 00000100:00100000:2.0:1769074937.585336:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:68024:x1855007616261376:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4691us (4906us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.585345:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2892 00000100:00100000:0.0:1769074937.589876:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626652032:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074937.589905:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074937.589973:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91614c09f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2420:x1855007616261504:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5755us (5980us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.589983:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1972 00000100:00100000:3.0:1769074937.594195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074937.594500:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261760 00000100:00100000:1.0:1769074937.594514:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261760 00000100:00100000:1.0:1769074937.594615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1957 00000100:00100000:1.0:1769074937.594627:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+443:68024:x1855007616261760:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074937.595000:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68024:x1855007616261760:12345-192.168.204.32@tcp:35:cp.0 Request processed in 372us (815us total) trans 4294969203 rc 0/0 00000100:00100000:1.0:1769074937.595008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1957 00000100:00100000:3.0:1769074937.640626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.641227:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616261888 00000100:00100000:2.0:1769074937.641240:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616261888 00000100:00100000:2.0:1769074937.641300:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9938 00000100:00100000:2.0:1769074937.641311:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68028:x1855007616261888:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074937.641330:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.641351:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede54 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbf0 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.641417:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.641431:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641442:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641457:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.641463:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641469:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641855:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641863:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641871:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641876:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.641880:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641887:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641900:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.641903:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.641908:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641913:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede5b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641928:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641933:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641947:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641953:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.641955:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641962:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641973:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89700) 00010000:00010000:2.0:1769074937.641976:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.641979:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.641984:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede62 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.642020:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede54 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbf0 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.642031:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.642034:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.642038:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbf0 expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.642047:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12be00, rc 0) 00000100:00100000:2.0:1769074937.642311:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68028:x1855007616261888:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1001us (1694us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.642320:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9938 00000100:00100000:3.0:1769074937.656247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.656351:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262016 00000100:00100000:2.0:1769074937.656362:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262016 00000100:00100000:2.0:1769074937.656421:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9939 00000100:00100000:2.0:1769074937.656430:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68029:x1855007616262016:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.656455:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.656475:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbf7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.656601:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.656615:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656628:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656641:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.656648:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656654:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656706:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656713:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656720:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656726:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.656730:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656737:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656753:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.656756:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.656761:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656767:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fede70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656780:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656785:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656791:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656796:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.656799:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656803:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656809:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89700) 00010000:00010000:2.0:1769074937.656811:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.656814:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656818:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fede77 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.656848:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede69 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbf7 expref: 445 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.656857:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.656859:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.656862:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fede69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbf7 expref: 445 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.656870:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12be00, rc 0) 00000100:00100000:2.0:1769074937.656933:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68029:x1855007616262016:12345-192.168.204.32@tcp:101:rm.0 Request processed in 503us (694us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.656969:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9939 00000100:00100000:3.0:1769074937.660516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.664130:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262144 00000100:00100000:0.0:1769074937.664146:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262144 00000100:00100000:0.0:1769074937.664228:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 329 00000100:00100000:0.0:1769074937.664238:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:2418:x1855007616262144:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074937.664278:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.664299:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fede7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cbfe expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.664357:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.664372:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664382:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664398:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.664406:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664412:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664460:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664467:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664475:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664481:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.664485:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664508:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664521:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.664524:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.664548:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664917:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fac00/0x557988ac98fede85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664932:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664938:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664953:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664959:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.664962:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664968:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664981:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x468b55fd (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.664984:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.664987:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.664992:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fede8c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x468b55fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.665020:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fede7e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbfe expref: 445 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.665028:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.665030:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074937.665034:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fede7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cbfe expref: 445 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.665042:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fbe00, rc -2) 00000100:00100000:0.0:1769074937.665135:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:2418:x1855007616262144:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 897us (4626us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074937.665144:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 329 00000100:00100000:0.0:1769074937.668998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.669081:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262272 00000100:00100000:3.0:1769074937.669091:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262272 00000100:00100000:3.0:1769074937.669154:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9940 00000100:00100000:3.0:1769074937.669164:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68029:x1855007616262272:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074937.669186:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.669207:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede93 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.669277:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.669292:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669302:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669316:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.669323:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669330:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669383:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669389:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669395:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669406:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669411:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.669416:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669423:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669436:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.669438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.669443:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669449:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fede9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669462:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669468:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669474:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669480:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.669482:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669488:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669863:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.669866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.669869:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedea1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.669910:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede93 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc05 expref: 445 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.669920:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.669923:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.669926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fede93 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc05 expref: 445 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.669936:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc 0) 00000100:00100000:3.0:1769074937.670078:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68029:x1855007616262272:12345-192.168.204.32@tcp:101:rm.0 Request processed in 913us (1087us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.670086:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9940 00000100:00100000:3.0:1769074937.687511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.687712:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262400 00000100:00100000:2.0:1769074937.687724:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262400 00000100:00100000:2.0:1769074937.687787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9941 00000100:00100000:2.0:1769074937.687797:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68030:x1855007616262400:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.687819:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.687841:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fedea8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc0c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.687910:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.687925:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.687937:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.687964:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.687975:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.687982:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688031:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688038:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688045:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688051:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688057:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.688061:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688069:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688082:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.688085:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.688090:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688096:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedeaf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688124:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688131:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688137:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688142:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.688145:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688150:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89700) 00010000:00010000:2.0:1769074937.688160:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.688162:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688167:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98fedeb6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.688198:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fedea8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc0c expref: 445 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.688207:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.688209:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.688213:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fedea8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc0c expref: 445 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.688221:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12be00, rc 0) 00000100:00100000:2.0:1769074937.688287:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68030:x1855007616262400:12345-192.168.204.32@tcp:101:cp.0 Request processed in 492us (797us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.688295:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9941 00000100:00100000:0.0:1769074937.694512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.694721:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262528 00000100:00100000:3.0:1769074937.694732:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262528 00000100:00100000:3.0:1769074937.694793:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9942 00000100:00100000:3.0:1769074937.694803:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68030:x1855007616262528:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074937.694824:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.694844:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedebd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc13 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.694917:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.694933:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.694953:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.694968:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.694975:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.694982:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695039:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695046:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695052:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695058:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.695063:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695070:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695086:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.695090:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.695094:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695110:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedec4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695125:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695130:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695136:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695141:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.695144:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695149:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695156:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.695158:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.695161:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695166:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedecb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.695198:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedebd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc13 expref: 445 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.695208:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.695211:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.695214:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedebd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc13 expref: 445 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.695222:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f423a00, rc 0) 00000100:00100000:3.0:1769074937.695284:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68030:x1855007616262528:12345-192.168.204.32@tcp:101:cp.0 Request processed in 482us (796us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.695292:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9942 00000100:00100000:0.0:1769074937.704653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.705047:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262784 00000100:00100000:2.0:1769074937.705057:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262784 00000100:00100000:2.0:1769074937.705125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9943 00000100:00100000:2.0:1769074937.705135:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+444:68030:x1855007616262784:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.705156:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.705178:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98feded2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc1a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.705294:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.705308:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705320:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705333:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x37007d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.705340:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705346:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074937.705688:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xe1:0x0], index 1: 0 00010000:00010000:2.0:1769074937.705835:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a800/0x557988ac98fedee7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.705845:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a800/0x557988ac98fedee7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705853:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a800/0x557988ac98fedee7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705888:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705895:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705901:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705907:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705913:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12bc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.705917:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705925:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705936:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.705948:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.705953:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705959:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12bc00/0x557988ac98feded9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074937.705971:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003fd0256a reply state 00000000bd91802f transno 4294969204 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705981:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.705987:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89700) 00010000:00010000:2.0:1769074937.705989:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.705992:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.706029:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98feded2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc1a expref: 447 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.706042:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a800/0x557988ac98fedee7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc1a expref: 446 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.706049:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1cb:0x0].0x0 (ffff91604ec89100) 00010000:00010000:2.0:1769074937.706052:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.706054:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a800, rc 0) 00000100:00100000:2.0:1769074937.706327:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:68030:x1855007616262784:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1192us (1684us total) trans 4294969204 rc 0/0 00000100:00100000:2.0:1769074937.706335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9943 00000100:00100000:1.0:1769074937.711902:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.711999:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616262912 00000100:00100000:2.0:1769074937.712010:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616262912 00000100:00100000:2.0:1769074937.712069:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2893 00000100:00100000:2.0:1769074937.712079:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2417:x1855007616262912:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.712097:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.712130:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc21 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074937.712154:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074937.712173:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.712175:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.712184:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 227 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.712203:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 227 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.712216:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12be00, rc 0) 00000100:00100000:2.0:1769074937.712277:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2417:x1855007616262912:12345-192.168.204.32@tcp:101:cp.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.712284:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2893 00000100:00100000:1.0:1769074937.716082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.716185:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263040 00000100:00100000:2.0:1769074937.716196:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263040 00000100:00100000:2.0:1769074937.716258:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2894 00000100:00100000:2.0:1769074937.716268:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:68030:x1855007616263040:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.716287:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.716308:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc28 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.716339:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.716347:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.716349:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.716353:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc28 expref: 228 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.716386:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.716407:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:2.0:1769074937.716422:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626652160:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074937.716870:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052a5c900 going to sleep for 11 seconds 00000100:00100000:2.0:1769074937.719809:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626652160:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074937.719848:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc28 expref: 228 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.719867:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12bc00, rc 0) 00000100:00100000:2.0:1769074937.719933:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:68030:x1855007616263040:12345-192.168.204.32@tcp:101:cp.0 Request processed in 3662us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.719951:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2894 00000100:00100000:1.0:1769074937.722484:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.722602:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263168 00000100:00100000:0.0:1769074937.722614:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263168 00010000:00010000:0.0:1769074937.722680:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074937.722722:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1973 00000100:00100000:0.0:1769074937.722733:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616263168:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074937.722747:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074937.722768:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074937.722781:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074937.722807:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fedef5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc21 expref: 228 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074937.722826:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.722828:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.722834:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc28 expref: 227 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.722843:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc28 expref: 227 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.722885:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f12bc00/0x557988ac98fedefc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc28 expref: 227 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074937.722899:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626652288:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074937.722996:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1769074937.726384:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff7b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626652288:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074937.726411:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074937.726469:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2420:x1855007616263168:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 3736us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.726480:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1973 00000100:00100000:3.0:1769074937.730004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.730120:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263424 00000100:00100000:2.0:1769074937.730133:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263424 00000100:00100000:2.0:1769074937.730197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1958 00000100:00100000:2.0:1769074937.730207:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+447:68030:x1855007616263424:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:2.0:1769074937.730857:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68030:x1855007616263424:12345-192.168.204.32@tcp:35:cp.0 Request processed in 326us (539us total) trans 4294969205 rc 0/0 00000100:00100000:2.0:1769074937.730866:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1958 00000100:00100000:1.0:1769074937.783990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.784083:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263552 00000100:00100000:3.0:1769074937.784108:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263552 00000100:00100000:3.0:1769074937.784173:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9944 00000100:00100000:3.0:1769074937.784183:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68034:x1855007616263552:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074937.784208:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.784231:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf03 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc2f expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.784303:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.784317:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784328:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784342:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.784348:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784354:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784402:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784410:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784417:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784423:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.784427:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784433:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784443:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.784446:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.784450:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784455:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784467:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784473:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784477:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784482:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.784485:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784498:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784505:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.784508:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.784510:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784516:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.784596:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf03 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc2f expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.784606:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.784609:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.784612:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc2f expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.784621:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:3.0:1769074937.784696:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68034:x1855007616263552:12345-192.168.204.32@tcp:101:bash.0 Request processed in 515us (716us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.784703:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9944 00000100:00100000:0.0:1769074937.801648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.801798:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263680 00000100:00100000:2.0:1769074937.801808:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263680 00000100:00100000:2.0:1769074937.801867:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9945 00000100:00100000:2.0:1769074937.801876:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68035:x1855007616263680:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.801902:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.801923:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf18 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc36 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.801996:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.802010:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802020:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802034:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.802041:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802047:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802093:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802111:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802116:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802122:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802128:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.802133:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802140:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802150:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.802153:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.802157:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802163:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802177:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802182:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802188:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802193:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.802195:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802201:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802207:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff916174a68a00) 00010000:00010000:2.0:1769074937.802209:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.802211:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802220:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf26 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.802250:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf18 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc36 expref: 449 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.802260:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.802262:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.802265:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc36 expref: 449 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.802274:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc 0) 00000100:00100000:2.0:1769074937.802322:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68035:x1855007616263680:12345-192.168.204.32@tcp:101:rm.0 Request processed in 447us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.802329:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9945 00000100:00100000:1.0:1769074937.807364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.807450:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263808 00000100:00100000:3.0:1769074937.807461:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263808 00000100:00100000:3.0:1769074937.807575:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9946 00000100:00100000:3.0:1769074937.807586:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68035:x1855007616263808:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074937.807608:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.807628:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf2d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc3d expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.807692:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.807705:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807715:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807730:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.807736:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807742:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807794:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807801:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807807:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807813:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.807817:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807823:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807835:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.807838:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.807843:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807849:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807862:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807867:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807872:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807876:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.807879:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807884:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807891:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.807893:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.807897:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807902:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.807932:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf2d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc3d expref: 449 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.807951:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.807954:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.807958:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc3d expref: 449 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.807967:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:3.0:1769074937.808023:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68035:x1855007616263808:12345-192.168.204.32@tcp:101:rm.0 Request processed in 439us (668us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.808030:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9946 00000100:00100000:1.0:1769074937.814429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.814684:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616263936 00000100:00100000:0.0:1769074937.814695:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616263936 00000100:00100000:0.0:1769074937.814751:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 330 00000100:00100000:0.0:1769074937.814760:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:2420:x1855007616263936:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074937.814797:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.814817:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fedf42 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc44 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.814874:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.814887:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814897:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814909:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074937.814915:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814920:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814982:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814991:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.814996:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815001:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.815004:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815011:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815022:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.815025:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.815030:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815035:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb200/0x557988ac98fedf49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815047:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815052:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815056:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815061:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fb600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074937.815063:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815072:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815078:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7452dcca (ffff91604f1ad400) 00010000:00010000:0.0:1769074937.815080:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074937.815082:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815088:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb600/0x557988ac98fedf50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7452dcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074937.815122:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fedf42 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc44 expref: 449 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.815131:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074937.815133:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074937.815136:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fb000/0x557988ac98fedf42 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc44 expref: 449 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.815145:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb000, rc -2) 00000100:00100000:0.0:1769074937.815247:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:2420:x1855007616263936:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 488us (830us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074937.815255:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 330 00000100:00100000:0.0:1769074937.832653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.832747:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264064 00000100:00100000:2.0:1769074937.832757:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264064 00000100:00100000:2.0:1769074937.832811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9947 00000100:00100000:2.0:1769074937.832820:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68036:x1855007616264064:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.832840:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.832861:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.832930:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.832957:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.832971:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.832986:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.832992:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.832998:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833045:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833053:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833060:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833066:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833072:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.833076:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833084:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.833110:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.833116:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833123:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833136:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833142:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833148:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833153:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.833157:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833162:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833169:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff916174a68a00) 00010000:00010000:2.0:1769074937.833172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.833175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.833211:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf57 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc4b expref: 449 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.833221:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.833224:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.833227:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc4b expref: 449 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.833235:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc 0) 00000100:00100000:2.0:1769074937.833288:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68036:x1855007616264064:12345-192.168.204.32@tcp:101:cp.0 Request processed in 469us (646us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.833295:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9947 00000100:00100000:1.0:1769074937.839408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.839489:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264192 00000100:00100000:3.0:1769074937.839510:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264192 00000100:00100000:3.0:1769074937.839609:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9948 00000100:00100000:3.0:1769074937.839620:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68036:x1855007616264192:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074937.839640:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.839661:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf6c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc52 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.839733:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.839747:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839762:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839777:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.839783:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839788:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839839:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839846:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839851:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839856:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.839860:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839867:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839878:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.839881:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.839885:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839891:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedf73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839904:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839909:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839914:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839919:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.839922:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839927:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839934:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff91604e58c100) 00010000:00010000:3.0:1769074937.839946:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.839949:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839954:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedf7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.839987:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf6c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc52 expref: 449 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.839997:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.839999:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.840002:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedf6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc52 expref: 449 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.840015:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc 0) 00000100:00100000:3.0:1769074937.840068:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68036:x1855007616264192:12345-192.168.204.32@tcp:101:cp.0 Request processed in 450us (669us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.840075:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9948 00000100:00100000:1.0:1769074937.844832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.844954:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264448 00000100:00100000:2.0:1769074937.844966:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264448 00000100:00100000:2.0:1769074937.845029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9949 00000100:00100000:2.0:1769074937.845039:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+448:68036:x1855007616264448:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.845059:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.845081:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf81 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.845227:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.845242:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.845253:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.845268:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.845275:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.845281:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074937.846051:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xe1:0x0], index 0: 0 00010000:00010000:2.0:1769074937.846286:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b200/0x557988ac98fedf96 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.846298:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b200/0x557988ac98fedf96 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846307:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b200/0x557988ac98fedf96 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846341:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846348:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846354:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846360:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846365:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.846369:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846376:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846389:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.846392:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.846397:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedf88 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074937.846422:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a6b9a857 reply state 00000000c5d8b952 transno 4294969206 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846432:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.846438:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff916174a68a00) 00010000:00010000:2.0:1769074937.846440:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.846442:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.846474:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fedf81 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc59 expref: 451 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.846487:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b200/0x557988ac98fedf96 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc59 expref: 450 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.846505:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1cc:0x0].0x0 (ffff91604e63ce00) 00010000:00010000:2.0:1769074937.846507:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.846510:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b200, rc 0) 00000100:00100000:2.0:1769074937.846610:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:68036:x1855007616264448:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1570us (1787us total) trans 4294969206 rc 0/0 00000100:00100000:2.0:1769074937.846618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9949 00000100:00100000:0.0:1769074937.855589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.855749:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264576 00000100:00100000:2.0:1769074937.855761:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264576 00000100:00100000:2.0:1769074937.855822:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2895 00000100:00100000:2.0:1769074937.855831:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2419:x1855007616264576:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.855851:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.855873:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc60 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074937.855899:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074937.855917:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.855919:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.855928:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 237 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.855957:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 237 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.855969:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc 0) 00000100:00100000:2.0:1769074937.856021:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2419:x1855007616264576:12345-192.168.204.32@tcp:101:cp.0 Request processed in 190us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.856028:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2895 00000100:00100000:1.0:1769074937.860374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.860696:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264704 00000100:00100000:0.0:1769074937.860707:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264704 00000100:00100000:0.0:1769074937.860768:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2896 00000100:00100000:0.0:1769074937.860778:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:68036:x1855007616264704:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074937.860798:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.860816:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc67 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.860846:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 238 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074937.860854:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.860856:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.860860:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc67 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.860897:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 238 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074937.860910:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 238 pid: 24956 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074937.860925:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604355a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626652416:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074937.861046:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1769074937.864649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.864765:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616264832 00000100:00100000:2.0:1769074937.864776:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616264832 00010000:00010000:2.0:1769074937.864831:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00000100:00100000:2.0:1769074937.864872:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1974 00000100:00100000:2.0:1769074937.864882:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2419:x1855007616264832:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1769074937.864897:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1769074937.864920:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00010000:00010000:2.0:1769074937.864950:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00010000:00010000:2.0:1769074937.864976:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.864979:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.864986:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc67 expref: 239 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.864996:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc67 expref: 239 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.865040:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc67 expref: 239 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1769074937.865055:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626652544:192.168.204.32@tcp:105: 00000100:00100000:2.0:1769074937.865150:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052a5c480 going to sleep for 11 seconds 00010000:00010000:0.0:1769074937.865747:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f12a000/0x557988ac98fedfa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc60 expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074937.865765:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604355a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626652416:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074937.865789:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f4fb600/0x557988ac98fedfab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc67 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.865805:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fb600, rc 0) 00000100:00100000:0.0:1769074937.865853:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:68036:x1855007616264704:12345-192.168.204.32@tcp:101:cp.0 Request processed in 5075us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.865861:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2896 00000100:00100000:3.0:1769074937.871384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.871834:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265088 00000100:00100000:0.0:1769074937.871846:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265088 00000100:00100000:0.0:1769074937.871900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1959 00000100:00100000:0.0:1769074937.871910:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+451:68036:x1855007616265088:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:0.0:1769074937.872248:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68036:x1855007616265088:12345-192.168.204.32@tcp:35:cp.0 Request processed in 339us (874us total) trans 4294969207 rc 0/0 00000100:00100000:0.0:1769074937.872257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1959 00000100:00100000:2.0:1769074937.872586:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a40000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626652544:192.168.204.32@tcp:105: 00010000:00010000:2.0:1769074937.872607:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1769074937.872631:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2419:x1855007616264832:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7751us (7996us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.872639:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1974 00000100:00100000:1.0:1769074937.907038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.907297:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265216 00000100:00100000:2.0:1769074937.907308:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265216 00000100:00100000:2.0:1769074937.907371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9950 00000100:00100000:2.0:1769074937.907380:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68039:x1855007616265216:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074937.907406:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.907426:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfb2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc6e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.907499:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.907514:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907526:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907608:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.907615:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907622:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907682:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907689:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907695:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907701:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907707:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.907712:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907720:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907731:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.907734:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.907739:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907744:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfb9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907760:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907766:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907771:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907776:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.907779:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907784:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907791:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e63c200) 00010000:00010000:2.0:1769074937.907794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.907796:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907806:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.907838:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfb2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc6e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.907848:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.907850:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.907854:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfb2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc6e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.907862:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b400, rc 0) 00000100:00100000:2.0:1769074937.907929:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68039:x1855007616265216:12345-192.168.204.32@tcp:101:bash.0 Request processed in 549us (903us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.907947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9950 00000100:00100000:3.0:1769074937.922241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.922409:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265344 00000100:00100000:2.0:1769074937.922419:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265344 00000100:00100000:2.0:1769074937.922479:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9951 00000100:00100000:2.0:1769074937.922499:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68040:x1855007616265344:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074937.922524:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.922587:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc75 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.922656:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.922672:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922686:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922700:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074937.922706:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922712:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922762:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922769:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922775:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922780:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.922784:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922792:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922804:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.922806:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.922811:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922817:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fedfce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922830:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922836:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922841:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922845:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.922848:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922854:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922860:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e63c200) 00010000:00010000:2.0:1769074937.922863:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.922866:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922871:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fedfd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074937.922900:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfc7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc75 expref: 453 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.922909:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.922911:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.922915:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fedfc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc75 expref: 453 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.922928:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b400, rc 0) 00000100:00100000:2.0:1769074937.923005:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68040:x1855007616265344:12345-192.168.204.32@tcp:101:rm.0 Request processed in 515us (773us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.923013:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9951 00000100:00100000:0.0:1769074937.929990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.930093:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265472 00000100:00100000:3.0:1769074937.930116:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265472 00000100:00100000:3.0:1769074937.930190:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 331 00000100:00100000:3.0:1769074937.930203:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:2420:x1855007616265472:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:3.0:1769074937.930242:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.930264:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedfdc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc7c expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.930321:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074937.930336:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930347:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930361:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:3.0:1769074937.930368:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930374:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930430:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930438:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930445:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930451:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.930455:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930461:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930472:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.930474:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.930479:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.930485:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423200/0x557988ac98fedfe3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931216:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931224:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931230:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931235:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f423a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.931239:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931245:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931255:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x880ce35a (ffff91604e58c100) 00010000:00010000:3.0:1769074937.931258:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.931261:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931267:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f423a00/0x557988ac98fedfea lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x880ce35a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:3.0:1769074937.931303:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedfdc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc7c expref: 453 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.931313:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.931315:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1769074937.931318:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fedfdc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc7c expref: 453 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.931326:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422000, rc -2) 00000100:00100000:3.0:1769074937.931457:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:2420:x1855007616265472:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 1256us (1475us total) trans 0 rc -2/-2 00000100:00100000:3.0:1769074937.931467:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 331 00000100:00100000:1.0:1769074937.935401:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.935483:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265600 00000100:00100000:3.0:1769074937.935505:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265600 00000100:00100000:3.0:1769074937.935590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9952 00000100:00100000:3.0:1769074937.935600:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68040:x1855007616265600:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074937.935623:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.935644:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedff1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.935708:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.935724:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935735:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935750:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074937.935757:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935762:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935816:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935823:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935828:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935833:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935838:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.935842:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935849:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935859:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.935862:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.935866:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935872:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fedff8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935886:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935891:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935896:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935901:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d2400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.935903:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935909:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935917:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e58c900) 00010000:00010000:3.0:1769074937.935920:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.935922:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935931:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fedfff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074937.935976:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedff1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc83 expref: 453 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.935986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.935988:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.935991:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fedff1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc83 expref: 453 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.936000:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074937.936071:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68040:x1855007616265600:12345-192.168.204.32@tcp:101:rm.0 Request processed in 471us (682us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.936079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9952 00000100:00100000:2.0:1769074937.953727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.953875:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265728 00000100:00100000:3.0:1769074937.953887:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265728 00000100:00100000:3.0:1769074937.953961:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9953 00000100:00100000:3.0:1769074937.953972:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68041:x1855007616265728:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074937.953994:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074937.954016:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fee006 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc8a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.954086:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.954113:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954130:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954149:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:3.0:1769074937.954157:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954163:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954212:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954219:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954225:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954230:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.954235:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954242:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954254:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.954257:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.954262:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954267:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3200/0x557988ac98fee00d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954280:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954285:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954290:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954294:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074937.954297:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954303:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954309:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e58c900) 00010000:00010000:3.0:1769074937.954311:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.954314:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954318:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee014 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:3.0:1769074937.954347:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fee006 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc8a expref: 453 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.954355:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074937.954358:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074937.954361:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d2400/0x557988ac98fee006 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc8a expref: 453 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074937.954374:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f3d2400, rc 0) 00000100:00100000:3.0:1769074937.954439:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68041:x1855007616265728:12345-192.168.204.32@tcp:101:cp.0 Request processed in 468us (721us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074937.954448:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9953 00000100:00100000:1.0:1769074937.959162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.959392:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616265856 00000100:00100000:2.0:1769074937.959402:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616265856 00000100:00100000:2.0:1769074937.959462:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9954 00000100:00100000:2.0:1769074937.959472:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68041:x1855007616265856:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.959503:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.959526:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee01b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.959925:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.959967:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.959980:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.959998:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.960004:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960010:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960061:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960068:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960074:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960081:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960087:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.960092:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960110:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960122:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.960125:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.960129:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960135:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee022 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960149:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960155:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960159:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960165:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ba00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.960167:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960173:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960180:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e63c200) 00010000:00010000:2.0:1769074937.960182:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.960185:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee029 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.960223:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee01b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc91 expref: 453 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.960234:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.960236:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.960239:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee01b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc91 expref: 453 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.960248:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b400, rc 0) 00000100:00100000:2.0:1769074937.960321:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68041:x1855007616265856:12345-192.168.204.32@tcp:101:cp.0 Request processed in 849us (1167us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074937.960329:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9954 00000100:00100000:1.0:1769074937.965652:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.965760:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266112 00000100:00100000:2.0:1769074937.965772:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266112 00000100:00100000:2.0:1769074937.965828:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9955 00000100:00100000:2.0:1769074937.965837:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+452:68041:x1855007616266112:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.965858:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.965879:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fee030 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc98 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.966020:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.966035:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966045:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966061:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xb91b273d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.966069:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966075:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1769074937.966526:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xe2:0x0], index 1: 0 00010000:00010000:2.0:1769074937.966720:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fee045 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1769074937.966731:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fee045 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966738:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fee045 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966777:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966784:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966789:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966794:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966800:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074937.966804:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966811:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966822:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074937.966825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074937.966830:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966835:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee037 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1769074937.966850:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000df4eef3e reply state 00000000b75d4e0f transno 4294969208 ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966861:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1769074937.966866:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e63cd00) 00010000:00010000:2.0:1769074937.966869:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074937.966872:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074937.966903:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12be00/0x557988ac98fee030 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc98 expref: 455 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.966916:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f000/0x557988ac98fee045 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc98 expref: 454 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.966923:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1cd:0x0].0x0 (ffff91604f135f00) 00010000:00010000:2.0:1769074937.966925:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074937.966927:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604ea9f000, rc 0) 00000100:00100000:2.0:1769074937.967014:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:68041:x1855007616266112:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1178us (1373us total) trans 4294969208 rc 0/0 00000100:00100000:2.0:1769074937.967022:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9955 00000100:00100000:3.0:1769074937.972863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.972974:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266240 00000100:00100000:0.0:1769074937.972985:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266240 00000100:00100000:0.0:1769074937.973041:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2897 00000100:00100000:0.0:1769074937.973052:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616266240:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074937.973071:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074937.973092:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cc9f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074937.973125:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074937.973150:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.973152:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.973160:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 228 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074937.973180:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 228 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074937.973193:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fba00, rc 0) 00000100:00100000:0.0:1769074937.973255:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2419:x1855007616266240:12345-192.168.204.32@tcp:101:cp.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.973262:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2897 00000100:00100000:1.0:1769074937.978744:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074937.978848:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266368 00000100:00100000:2.0:1769074937.978859:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266368 00000100:00100000:2.0:1769074937.978921:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2898 00000100:00100000:2.0:1769074937.978930:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:68041:x1855007616266368:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074937.978960:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074937.978980:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cca6 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.979010:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 229 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.979017:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.979019:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074937.979023:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cca6 expref: 229 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.979062:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 229 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074937.979075:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 229 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:2.0:1769074937.979088:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626652672:192.168.204.32@tcp:104: 00000100:00100000:2.0:1769074937.979200:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052a5cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1769074937.982437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074937.982582:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266496 00000100:00100000:0.0:1769074937.982592:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266496 00010000:00010000:0.0:1769074937.982650:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074937.982682:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1975 00000100:00100000:0.0:1769074937.982692:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2420:x1855007616266496:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074937.982708:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074937.982731:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074937.982745:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074937.982772:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.982774:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074937.982781:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cca6 expref: 230 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.982797:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cca6 expref: 230 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074937.982834:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cca6 expref: 230 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074937.982847:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604369df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626652800:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074937.982949:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6480 going to sleep for 11 seconds 00010000:00010000:2.0:1769074937.983612:0:24956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fba00/0x557988ac98fee053 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cc9f expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:2.0:1769074937.983630:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626652672:192.168.204.32@tcp:104: 00010000:00010000:2.0:1769074937.983659:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f12be00/0x557988ac98fee05a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cca6 expref: 229 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074937.983670:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12be00, rc 0) 00000100:00100000:2.0:1769074937.983720:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:68041:x1855007616266368:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4790us (4986us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074937.983729:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2898 00000100:00100000:1.0:1769074937.987993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074937.988081:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266752 00000100:00100000:3.0:1769074937.988091:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266752 00000100:00100000:3.0:1769074937.988159:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1960 00000100:00100000:3.0:1769074937.988169:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+455:68041:x1855007616266752:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074937.988891:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68041:x1855007616266752:12345-192.168.204.32@tcp:35:cp.0 Request processed in 719us (904us total) trans 4294969209 rc 0/0 00000100:00100000:3.0:1769074937.988901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1960 00000100:00100000:0.0:1769074937.989016:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604369df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626652800:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074937.989038:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074937.989064:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616266496:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 6374us (6637us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074937.989071:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1975 00010000:00010000:1.0:1769074938.035918:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074938.045254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.045434:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616266880 00000100:00100000:2.0:1769074938.045444:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616266880 00000100:00100000:2.0:1769074938.045504:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9956 00000100:00100000:2.0:1769074938.045514:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68044:x1855007616266880:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1769074938.045571:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.045594:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee061 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccad expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.045661:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.045675:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045686:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045700:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.045707:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045713:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045764:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045771:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045777:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045782:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.045787:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045795:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045808:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.045811:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.045815:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045821:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee068 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045834:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045840:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045845:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045849:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.045851:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045856:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045862:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604f135700) 00010000:00010000:2.0:1769074938.045864:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.045867:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045872:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee06f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.045901:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee061 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccad expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.045912:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.045914:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.045918:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee061 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccad expref: 7 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.045926:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b600, rc 0) 00000100:00100000:2.0:1769074938.046008:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68044:x1855007616266880:12345-192.168.204.32@tcp:101:bash.0 Request processed in 495us (763us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074938.046016:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9956 00000100:00100000:1.0:1769074938.059336:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.059425:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267008 00000100:00100000:3.0:1769074938.059436:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267008 00000100:00100000:3.0:1769074938.059501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9957 00000100:00100000:3.0:1769074938.059510:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68045:x1855007616267008:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1769074938.059586:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074938.059609:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee076 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccb4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.059687:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.059702:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059718:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059732:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.059739:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059744:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059797:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059804:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059811:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059817:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059823:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.059827:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059834:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059846:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.059849:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.059854:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee07d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059873:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059879:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059884:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059888:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.059891:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059896:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059902:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604e58c900) 00010000:00010000:3.0:1769074938.059905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.059907:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059912:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee084 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.059973:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee076 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccb4 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.059982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.059985:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.059989:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee076 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccb4 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.059997:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074938.060055:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68045:x1855007616267008:12345-192.168.204.32@tcp:101:rm.0 Request processed in 545us (728us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074938.060062:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9957 00000100:00100000:1.0:1769074938.065769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074938.065867:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267136 00000100:00100000:0.0:1769074938.065876:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267136 00000100:00100000:0.0:1769074938.065930:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 332 00000100:00100000:0.0:1769074938.065949:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:2420:x1855007616267136:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074938.065984:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074938.066004:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee08b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccbb expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.066059:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074938.066074:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066085:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066182:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:0.0:1769074938.066191:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066198:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066251:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066258:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066263:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066268:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbe00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.066272:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066279:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066290:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.066293:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.066297:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066302:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee092 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066314:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066319:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066324:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066328:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.066330:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066335:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066341:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xed78eb5 (ffff91604f1ad800) 00010000:00010000:0.0:1769074938.066342:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.066345:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066349:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa000/0x557988ac98fee099 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xed78eb5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:0.0:1769074938.066373:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee08b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccbb expref: 457 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.066382:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.066384:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074938.066387:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee08b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccbb expref: 457 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.066400:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fbc00, rc -2) 00000100:00100000:0.0:1769074938.066471:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:2420:x1855007616267136:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 520us (708us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074938.066481:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 332 00000100:00100000:0.0:1769074938.071660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.072225:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267264 00000100:00100000:2.0:1769074938.072237:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267264 00000100:00100000:2.0:1769074938.072301:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9958 00000100:00100000:2.0:1769074938.072311:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68045:x1855007616267264:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074938.072331:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.072352:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee0a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccc2 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.072413:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.072427:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072438:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072450:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.072460:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072465:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072526:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072572:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072578:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072584:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.072588:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072595:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072607:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.072611:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.072616:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072622:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072635:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072640:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072647:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072651:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.072654:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072660:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072666:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604f135700) 00010000:00010000:2.0:1769074938.072668:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.072670:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072675:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.072707:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee0a0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccc2 expref: 457 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.072716:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.072718:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.072723:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee0a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccc2 expref: 457 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.072732:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b600, rc 0) 00000100:00100000:2.0:1769074938.072788:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68045:x1855007616267264:12345-192.168.204.32@tcp:101:rm.0 Request processed in 478us (1139us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074938.072796:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9958 00000100:00100000:1.0:1769074938.123054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.123210:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267392 00000100:00100000:3.0:1769074938.123222:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267392 00000100:00100000:3.0:1769074938.123287:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9959 00000100:00100000:3.0:1769074938.123296:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68046:x1855007616267392:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074938.123317:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074938.123338:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccc9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.123405:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.123420:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123429:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123443:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.123448:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123454:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123504:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123511:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123518:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123523:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123528:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.123776:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123784:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123796:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.123799:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.123802:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123809:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123822:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123828:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123833:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123837:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.123840:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123845:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123852:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604e58c900) 00010000:00010000:3.0:1769074938.123854:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.123857:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123861:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.123892:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0b5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccc9 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.123903:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.123905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.123908:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccc9 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.123917:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074938.124030:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68046:x1855007616267392:12345-192.168.204.32@tcp:101:cp.0 Request processed in 734us (985us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074938.124038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9959 00000100:00100000:1.0:1769074938.129433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.130570:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267520 00000100:00100000:3.0:1769074938.130583:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267520 00000100:00100000:3.0:1769074938.130661:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9960 00000100:00100000:3.0:1769074938.130673:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68046:x1855007616267520:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074938.130692:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074938.130711:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccd0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.130782:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.130796:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130806:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130820:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.130827:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130833:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130888:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130894:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130900:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130905:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130912:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.130916:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130922:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130943:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.130946:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.130951:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130958:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee0d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130971:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130976:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130981:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130985:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.130987:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130992:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.130998:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604e58c900) 00010000:00010000:3.0:1769074938.131000:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.131004:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.131009:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee0d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.131040:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0ca lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccd0 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.131049:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.131051:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.131055:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee0ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccd0 expref: 457 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.131063:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074938.131148:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68046:x1855007616267520:12345-192.168.204.32@tcp:101:cp.0 Request processed in 478us (1725us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074938.131156:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9960 00000100:00100000:0.0:1769074938.138723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.138816:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267776 00000100:00100000:2.0:1769074938.138827:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267776 00000100:00100000:2.0:1769074938.138886:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9961 00000100:00100000:2.0:1769074938.138895:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+456:68046:x1855007616267776:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074938.138917:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.138947:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee0df lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccd7 expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.139060:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.139075:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139087:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139114:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x6282df54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.139122:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139129:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00000004:00080000:2.0:1769074938.139461:0:25310:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xe2:0x0], index 0: 0 00010000:00010000:2.0:1769074938.139654:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee0f4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.139663:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee0f4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139671:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee0f4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139699:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139706:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139712:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139719:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.139722:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139730:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139742:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.139745:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.139749:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139755:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee0e6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00000004:00010000:2.0:1769074938.139768:0:25310:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005534c7e8 reply state 000000008ea55e1e transno 4294969210 ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139778:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.139783:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604f135700) 00010000:00010000:2.0:1769074938.139785:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1769074938.139788:0:25310:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1769074938.139813:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee0df lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccd7 expref: 459 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.139825:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ba00/0x557988ac98fee0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccd7 expref: 458 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.139832:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1ce:0x0].0x0 (ffff91604f135500) 00010000:00010000:2.0:1769074938.139834:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1769074938.139837:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12ba00, rc 0) 00000100:00100000:2.0:1769074938.139907:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:68046:x1855007616267776:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1013us (1193us total) trans 4294969210 rc 0/0 00000100:00100000:2.0:1769074938.139916:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9961 00000100:00100000:1.0:1769074938.146670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.146798:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616267904 00000100:00100000:2.0:1769074938.146809:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616267904 00000100:00100000:2.0:1769074938.146865:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2899 00000100:00100000:2.0:1769074938.146875:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2419:x1855007616267904:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:2.0:1769074938.146894:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.146916:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccde expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1769074938.146953:0:24956:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1769074938.146974:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074938.146976:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1769074938.146985:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 238 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074938.147002:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 238 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1769074938.147021:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b600, rc 0) 00000100:00100000:2.0:1769074938.147084:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2419:x1855007616267904:12345-192.168.204.32@tcp:101:cp.0 Request processed in 210us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074938.147099:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2899 00000100:00100000:1.0:1769074938.163836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074938.163993:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268032 00000100:00100000:0.0:1769074938.164004:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268032 00000100:00100000:0.0:1769074938.164066:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2900 00000100:00100000:0.0:1769074938.164074:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:68046:x1855007616268032:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074938.164090:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074938.164113:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cce5 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.164138:0:8405:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074938.164144:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.164145:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.164148:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cce5 expref: 239 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.164176:0:8405:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074938.164189:0:8405:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074938.164203:0:8405:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626652928:192.168.204.32@tcp:104: 00000100:00100000:0.0:1769074938.164292:0:8405:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6300 going to sleep for 11 seconds 00000100:00100000:0.0:1769074938.168646:0:8405:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8405:1855007626652928:192.168.204.32@tcp:104: 00010000:00010000:0.0:1769074938.168683:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cce5 expref: 239 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.168702:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa000, rc 0) 00000100:00100000:0.0:1769074938.168768:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:68046:x1855007616268032:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4692us (4941us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074938.168777:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2900 00000100:00100000:1.0:1769074938.171145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074938.171236:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268160 00000100:00100000:0.0:1769074938.171246:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268160 00010000:00010000:0.0:1769074938.171304:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074938.171343:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1976 00000100:00100000:0.0:1769074938.171352:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2420:x1855007616268160:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074938.171366:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074938.171386:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.171399:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.171428:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff91604f12b600/0x557988ac98fee102 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccde expref: 239 pid: 24956 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.171445:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.171447:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.171454:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cce5 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.171464:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cce5 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.171500:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff91604f4fa000/0x557988ac98fee109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cce5 expref: 238 pid: 8405 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074938.171515:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626653056:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074938.171799:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6300 going to sleep for 11 seconds 00000100:00100000:1.0:1769074938.176744:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.177015:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268416 00000100:00100000:3.0:1769074938.177026:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268416 00000100:00100000:3.0:1769074938.177087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1961 00000100:00100000:3.0:1769074938.177226:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+459:68046:x1855007616268416:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:3.0:1769074938.177620:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68046:x1855007616268416:12345-192.168.204.32@tcp:35:cp.0 Request processed in 397us (887us total) trans 4294969211 rc 0/0 00000100:00100000:3.0:1769074938.177629:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1961 00000100:00100000:0.0:1769074938.178525:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1855007626653056:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074938.178574:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074938.178610:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616268160:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7259us (7478us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074938.178619:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1976 00000100:00100000:1.0:1769074938.210316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.211240:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268544 00000100:00100000:3.0:1769074938.211254:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268544 00000100:00100000:0.0:1769074938.211463:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 333 00000100:00100000:0.0:1769074938.211474:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2420:x1855007616268544:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074938.211570:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074938.211602:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee110 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ccec expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.211665:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074938.211680:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211691:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211707:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074938.211713:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211720:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211772:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211779:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211786:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211791:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.211795:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211802:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211815:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.211818:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.211823:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211830:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee117 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211844:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211850:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211855:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211860:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.211862:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211868:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211874:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x22057188 (ffff91604f1ad800) 00010000:00010000:0.0:1769074938.211877:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.211880:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211886:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee11e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x22057188 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.211914:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee110 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccec expref: 461 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.211923:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.211926:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074938.211929:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee110 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ccec expref: 461 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.211949:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fbe00, rc -2) 00000100:00100000:0.0:1769074938.212026:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2420:x1855007616268544:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 553us (1720us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074938.212036:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 333 00000100:00100000:1.0:1769074938.218652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.218738:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268672 00000100:00100000:3.0:1769074938.218748:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268672 00000100:00100000:3.0:1769074938.218803:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9962 00000100:00100000:3.0:1769074938.218813:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68051:x1855007616268672:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1769074938.218832:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074938.218858:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee125 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd24 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.218925:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.218951:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.218962:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.218976:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.218983:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.218988:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219048:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219056:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219062:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219069:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219075:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.219080:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219088:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219111:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.219114:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.219119:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219125:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee12c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219138:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219144:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219150:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219154:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.219157:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219163:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219170:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff91604e58c900) 00010000:00010000:3.0:1769074938.219172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.219175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219181:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee133 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.219209:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee125 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd24 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.219219:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.219221:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.219224:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee125 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd24 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.219234:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074938.219381:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:68051:x1855007616268672:12345-192.168.204.32@tcp:101:bash.0 Request processed in 568us (737us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074938.219389:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9962 00000100:00100000:1.0:1769074938.237287:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.237389:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268800 00000100:00100000:2.0:1769074938.237401:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268800 00000100:00100000:2.0:1769074938.237498:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9963 00000100:00100000:2.0:1769074938.237507:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68052:x1855007616268800:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074938.237528:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.237602:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee13a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd2b expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.237673:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.237687:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237698:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237712:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.237718:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237724:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237781:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237788:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237794:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237801:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.237805:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237812:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237824:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.237828:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.237833:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237838:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee141 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237852:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237858:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237863:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237868:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.237871:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237876:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237882:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff91604f135c00) 00010000:00010000:2.0:1769074938.237885:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.237888:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237893:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee148 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.237923:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee13a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd2b expref: 461 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.237945:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.237947:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.237951:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee13a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd2b expref: 461 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.237960:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc 0) 00000100:00100000:2.0:1769074938.238025:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68052:x1855007616268800:12345-192.168.204.32@tcp:101:rm.0 Request processed in 518us (749us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074938.238033:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9963 00000100:00100000:1.0:1769074938.242058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074938.242230:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616268928 00000100:00100000:0.0:1769074938.242241:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616268928 00000100:00100000:0.0:1769074938.242299:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 334 00000100:00100000:0.0:1769074938.242309:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2420:x1855007616268928:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:0.0:1769074938.242361:0:8415:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074938.242380:0:8415:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee14f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd32 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.242434:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074938.242448:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242458:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242472:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8415 initiator: MDT0 00010000:00010000:0.0:1769074938.242483:0:8415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242489:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242589:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242596:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242602:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242608:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fbc00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.242613:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242620:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242633:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.242637:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.242641:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242647:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbc00/0x557988ac98fee156 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242660:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242665:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242670:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242674:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f4fa600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:0.0:1769074938.242677:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242681:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242687:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604f1ad800) 00010000:00010000:0.0:1769074938.242690:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1769074938.242692:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242697:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fa600/0x557988ac98fee15d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8415 initiator: MDT1 00010000:00010000:0.0:1769074938.242723:0:8415:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee14f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd32 expref: 461 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.242733:0:8415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:0.0:1769074938.242736:0:8415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1769074938.242739:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f4fbe00/0x557988ac98fee14f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd32 expref: 461 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.242749:0:8415:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fbe00, rc -2) 00000100:00100000:0.0:1769074938.242804:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2420:x1855007616268928:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 497us (756us total) trans 0 rc -2/-2 00000100:00100000:0.0:1769074938.242812:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 334 00000100:00100000:1.0:1769074938.247962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.248122:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269056 00000100:00100000:2.0:1769074938.248132:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269056 00000100:00100000:2.0:1769074938.248194:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9964 00000100:00100000:2.0:1769074938.248203:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68052:x1855007616269056:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1769074938.248225:0:25310:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.248246:0:25310:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee164 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd6a expref: -99 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.248308:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.248322:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248332:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248346:0:25310:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25310 initiator: MDT0 00010000:00010000:2.0:1769074938.248352:0:25310:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248357:0:25310:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248409:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248417:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248423:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248429:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.248433:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248444:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248456:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.248459:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.248463:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248468:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee16b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248479:0:25310:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248484:0:25310:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248489:0:25310:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248494:0:25310:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.248496:0:25310:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248502:0:25310:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248508:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff91604f135c00) 00010000:00010000:2.0:1769074938.248510:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.248512:0:25310:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248517:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee172 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:2.0:1769074938.248679:0:25310:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee164 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd6a expref: 461 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.248689:0:25310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.248692:0:25310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.248696:0:25310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee164 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd6a expref: 461 pid: 25310 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.248706:0:25310:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc 0) 00000100:00100000:2.0:1769074938.248775:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68052:x1855007616269056:12345-192.168.204.32@tcp:101:rm.0 Request processed in 572us (822us total) trans 0 rc 301/301 00000100:00100000:2.0:1769074938.248782:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9964 00000100:00100000:1.0:1769074938.277054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074938.277497:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269184 00000100:00100000:3.0:1769074938.277510:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269184 00000100:00100000:3.0:1769074938.277616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9965 00000100:00100000:3.0:1769074938.277626:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68055:x1855007616269184:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:3.0:1769074938.277657:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1769074938.277681:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee179 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd7f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.277757:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.277771:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277784:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277798:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1769074938.277804:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277810:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277862:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277869:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277875:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277881:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277886:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.277891:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277899:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277911:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.277914:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.277919:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277925:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422c00/0x557988ac98fee180 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277949:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277955:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277961:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277970:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f422000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:3.0:1769074938.277972:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277977:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277985:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff91604e58c900) 00010000:00010000:3.0:1769074938.277987:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.277989:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.277995:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422000/0x557988ac98fee187 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1769074938.278027:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee179 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd7f expref: 461 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.278037:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:3.0:1769074938.278039:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1769074938.278043:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f422a00/0x557988ac98fee179 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd7f expref: 461 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1769074938.278051:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f422a00, rc 0) 00000100:00100000:3.0:1769074938.279465:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68055:x1855007616269184:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1830us (2411us total) trans 0 rc 301/301 00000100:00100000:3.0:1769074938.279477:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9965 00000100:00100000:1.0:1769074938.279961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.280797:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269312 00000100:00100000:2.0:1769074938.280807:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269312 00000100:00100000:2.0:1769074938.280907:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 335 00000100:00100000:2.0:1769074938.280917:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91616f542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2419:x1855007616269312:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074938.280982:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.281003:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee18e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cd71 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.281058:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074938.281073:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281083:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281113:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074938.281119:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281124:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281176:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281183:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281189:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281194:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.281198:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281206:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281218:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.281221:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.281225:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281231:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee195 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281245:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281252:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281257:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281262:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.281265:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281271:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281278:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604f135c00) 00010000:00010000:2.0:1769074938.281280:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.281283:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281289:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee19c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.281317:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee18e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd71 expref: 461 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.281326:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.281328:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074938.281332:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee18e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cd71 expref: 461 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.281341:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12a000, rc -2) 00000100:00100000:2.0:1769074938.281419:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91616f542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:2419:x1855007616269312:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 503us (1459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074938.281427:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 335 00000100:00100000:3.0:1769074938.286849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.287045:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269440 00000100:00100000:1.0:1769074938.287057:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269440 00000100:00100000:1.0:1769074938.287129:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9966 00000100:00100000:1.0:1769074938.287139:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68055:x1855007616269440:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074938.287161:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074938.287184:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fee1a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cdb0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.287263:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.287280:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287292:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287307:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.287314:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287320:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287373:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287380:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287385:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287395:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287401:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074938.287405:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287412:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287423:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074938.287426:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.287430:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287435:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48da00/0x557988ac98fee1aa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287449:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287454:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287459:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287464:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48c400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074938.287467:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287473:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287484:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff916052aa4a00) 00010000:00010000:1.0:1769074938.287486:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.287489:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287494:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c400/0x557988ac98fee1b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.287521:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fee1a3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdb0 expref: 461 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.287559:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074938.287561:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.287565:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f48c800/0x557988ac98fee1a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdb0 expref: 461 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.287574:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074938.287635:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68055:x1855007616269440:12345-192.168.204.32@tcp:101:cp.0 Request processed in 497us (795us total) trans 0 rc 301/301 00000100:00100000:1.0:1769074938.287643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9966 00000100:00100000:3.0:1769074938.293986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.294213:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269696 00000100:00100000:1.0:1769074938.294225:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269696 00000100:00100000:1.0:1769074938.294319:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9967 00000100:00100000:1.0:1769074938.294330:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+460:68055:x1855007616269696:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074938.294353:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074938.294376:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fee1b8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cdb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.294510:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.294525:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.294568:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.294582:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0xe22679c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.294589:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.294595:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1769074938.295006:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xe3:0x0], index 1: 0 00010000:00010000:1.0:1769074938.295135:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fee1cd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.295145:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fee1cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295152:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fee1cd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295182:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295189:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295199:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295206:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295211:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e297a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074938.295216:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295222:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295233:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:1.0:1769074938.295236:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.295239:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295245:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e297a00/0x557988ac98fee1bf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1769074938.295257:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3f356d0 reply state 000000003f236878 transno 4294969212 ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295266:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074938.295272:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff916052aa4800) 00010000:00010000:1.0:1769074938.295274:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1769074938.295277:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1769074938.295301:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e281a00/0x557988ac98fee1b8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdb7 expref: 463 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.295318:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff916044c6a200/0x557988ac98fee1cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdb7 expref: 462 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.295325:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1cf:0x0].0x0 (ffff916052aa4200) 00010000:00010000:1.0:1769074938.295328:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1769074938.295330:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916044c6a200, rc 0) 00000100:00100000:1.0:1769074938.295388:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:68055:x1855007616269696:12345-192.168.204.32@tcp:101:cp.0 Request processed in 1061us (1412us total) trans 4294969212 rc 0/0 00000100:00100000:1.0:1769074938.295395:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9967 00000100:00100000:3.0:1769074938.300101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074938.300267:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269824 00000100:00100000:0.0:1769074938.300278:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269824 00000100:00100000:0.0:1769074938.300392:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2901 00000100:00100000:0.0:1769074938.300403:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2420:x1855007616269824:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:0.0:1769074938.300421:0:8405:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1769074938.300442:0:8405:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cdbe expref: -99 pid: 8405 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1769074938.300467:0:8405:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1769074938.300486:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.300489:0:8405:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.300498:0:8405:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 229 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074938.300515:0:8405:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 229 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1769074938.300574:0:8405:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f4fa600, rc 0) 00000100:00100000:0.0:1769074938.300631:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2420:x1855007616269824:12345-192.168.204.32@tcp:101:cp.0 Request processed in 228us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074938.300638:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2901 00000100:00100000:3.0:1769074938.306168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.306290:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616269952 00000100:00100000:1.0:1769074938.306299:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616269952 00000100:00100000:1.0:1769074938.306351:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2902 00000100:00100000:1.0:1769074938.306357:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:68055:x1855007616269952:12345-192.168.204.32@tcp:101:cp.0 00010000:00010000:1.0:1769074938.306372:0:24956:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074938.306389:0:24956:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cdc5 expref: -99 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.306414:0:24956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074938.306421:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074938.306423:0:24956:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1769074938.306427:0:24956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdc5 expref: 230 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.306459:0:24956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1769074938.306474:0:24956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:1.0:1769074938.306485:0:24956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9160413b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626653184:192.168.204.32@tcp:104: 00000100:00100000:1.0:1769074938.306581:0:24956:0:(client.c:2690:ptlrpc_set_wait()) set ffff91604ed9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1769074938.310998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.311228:0:24956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9160413b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24956:1855007626653184:192.168.204.32@tcp:104: 00010000:00010000:1.0:1769074938.311261:0:24956:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdc5 expref: 230 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.311283:0:24956:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c800, rc 0) 00000100:00100000:1.0:1769074938.311346:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:68055:x1855007616269952:12345-192.168.204.32@tcp:101:cp.0 Request processed in 4988us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074938.311355:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2902 00000100:00100000:0.0:1769074938.313312:0:10340:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616270080 00000100:00100000:0.0:1769074938.313327:0:10340:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616270080 00010000:00010000:0.0:1769074938.313389:0:10340:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00000100:00100000:0.0:1769074938.313502:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1977 00000100:00100000:0.0:1769074938.313513:0:10340:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2419:x1855007616270080:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1769074938.313567:0:10340:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1769074938.313592:0:10340:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.313607:0:10340:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.313633:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff91604f4fa600/0x557988ac98fee1db lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdbe expref: 230 pid: 8405 timeout: 2027 lvb_type: 1 00010000:00010000:0.0:1769074938.313660:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.313662:0:10340:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1769074938.313669:0:10340:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdc5 expref: 229 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.313679:0:10340:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdc5 expref: 229 pid: 24956 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1769074938.313721:0:10340:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff91604f48c800/0x557988ac98fee1e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdc5 expref: 229 pid: 24956 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1769074938.313737:0:10340:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626653312:192.168.204.32@tcp:105: 00000100:00100000:0.0:1769074938.313841:0:10340:0:(client.c:2690:ptlrpc_set_wait()) set ffff916052ae6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1769074938.319431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.319558:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616270336 00000100:00100000:1.0:1769074938.319568:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616270336 00000100:00100000:1.0:1769074938.319626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1962 00000100:00100000:1.0:1769074938.319635:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916146e9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+463:68055:x1855007616270336:12345-192.168.204.32@tcp:35:cp.0 00000100:00100000:1.0:1769074938.319943:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916146e9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:68055:x1855007616270336:12345-192.168.204.32@tcp:35:cp.0 Request processed in 307us (521us total) trans 4294969213 rc 0/0 00000100:00100000:1.0:1769074938.319951:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1962 00000100:00100000:0.0:1769074938.320602:0:10340:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916181771500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1855007626653312:192.168.204.32@tcp:105: 00010000:00010000:0.0:1769074938.320625:0:10340:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1769074938.320671:0:10340:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2419:x1855007616270080:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7160us (9683us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074938.320681:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1977 00000100:00100000:3.0:1769074938.357379:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.357609:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616270464 00000100:00100000:2.0:1769074938.357620:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616270464 00000100:00100000:2.0:1769074938.357685:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 336 00000100:00100000:2.0:1769074938.357695:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:2418:x1855007616270464:12345-192.168.204.32@tcp:63:ll_sa.0 00010000:00010000:2.0:1769074938.357766:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1769074938.357786:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee1e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2cdcc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.357845:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074938.357861:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357871:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357886:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8414 initiator: MDT0 00010000:00010000:2.0:1769074938.357893:0:8414:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357899:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357965:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357972:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357978:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357984:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.357989:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.357996:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358007:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.358010:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.358015:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358020:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b000/0x557988ac98fee1f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358034:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358039:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358044:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358049:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:2.0:1769074938.358052:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358057:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358068:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7780928e (ffff91604f135c00) 00010000:00010000:2.0:1769074938.358071:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1769074938.358074:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358078:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a000/0x557988ac98fee1f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7780928e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8414 initiator: MDT1 00010000:00010000:2.0:1769074938.358108:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee1e9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdcc expref: 465 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.358116:0:8414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff916044b7d000) 00010000:00010000:2.0:1769074938.358118:0:8414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1769074938.358122:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b600/0x557988ac98fee1e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2cdcc expref: 465 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1769074938.358130:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f12b600, rc -2) 00000100:00100000:2.0:1769074938.358211:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:2418:x1855007616270464:12345-192.168.204.32@tcp:63:ll_sa.0 Request processed in 516us (842us total) trans 0 rc -2/-2 00000100:00100000:2.0:1769074938.358219:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 336 00000100:00100000:2.0:1769074938.684877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.685077:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616270720 00000100:00100000:1.0:1769074938.685089:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616270720 00000100:00100000:1.0:1769074938.685172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9968 00000100:00100000:1.0:1769074938.685182:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:68086:x1855007616270720:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1769074938.685203:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1769074938.685224:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48c400/0x557988ac98fee1fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe83a7ce271e2ce04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.685298:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685314:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685326:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685345:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685352:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685358:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000100:00080000:0.0:1769074938.685527:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1769074938.685701:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1769074938.685809:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685817:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685823:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685829:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685838:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f48da00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074938.685843:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685850:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685866:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9161771be200) 00010000:00010000:1.0:1769074938.685869:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.685873:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685879:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48da00/0x557988ac98fee205 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685893:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685899:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685904:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685909:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e281a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074938.685911:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685916:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685931:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff916052aa4a00) 00010000:00010000:1.0:1769074938.685934:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074938.685937:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685943:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91604e281a00/0x557988ac98fee20c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1769074938.685979:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48c400/0x557988ac98fee1fe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ce04 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.685989:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9161771be200) 00010000:00010000:1.0:1769074938.685991:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1769074938.685995:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91604f48c400/0x557988ac98fee1fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xe83a7ce271e2ce04 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1769074938.686003:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91604f48c400, rc 0) 00000100:00100000:1.0:1769074938.686106:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+36:68086:x1855007616270720:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 925us (1238us total) trans 8589934947 rc 301/301 00000100:00100000:1.0:1769074938.686113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9968 00000100:00100000:3.0:1769074938.692514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.692616:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616270976 00000100:00100000:1.0:1769074938.692627:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616270976 00000100:00100000:1.0:1769074938.692700:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1963 00000100:00100000:1.0:1769074938.692710:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+36:68086:x1855007616270976:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1769074938.692969:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+37:68086:x1855007616270976:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 259us (463us total) trans 8589934948 rc 0/0 00000100:00100000:1.0:1769074938.692977:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1963 00000100:00100000:3.0:1769074938.710851:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074938.710968:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271104 00000100:00100000:1.0:1769074938.710979:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271104 00000100:00100000:1.0:1769074938.711045:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9969 00000100:00100000:1.0:1769074938.711056:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+37:68086:x1855007616271104:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1769074938.711172:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+37:68086:x1855007616271104:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074938.711180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9969 00000100:00100000:3.0:1769074938.718991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074938.719807:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271232 00000100:00100000:2.0:1769074938.719820:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271232 00000100:00100000:2.0:1769074938.719885:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9970 00000100:00100000:2.0:1769074938.719894:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:68086:x1855007616271232:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1769074938.720013:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:68086:x1855007616271232:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 Request processed in 119us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074938.720025:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9970 00000040:00080000:3.0:1769074938.803860:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1769074938.803870:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769074938.804322:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1769074938.804332:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1769074938.934779:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1769074938.934787:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769074938.935502:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1769074938.935512:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1769074939.064330:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074939.607999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074939.608281:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271744 00000100:00100000:0.0:1769074939.608295:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271744 00000100:00100000:0.0:1769074939.608357:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271872 00000100:00100000:0.0:1769074939.608362:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271872 00000100:00100000:0.0:1769074939.608392:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2109 00000100:00100000:0.0:1769074939.608404:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616271744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.608477:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616271744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 76us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.608485:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2109 00000100:00100000:0.0:1769074939.608509:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2110 00000100:00100000:0.0:1769074939.608518:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616271872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.608573:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616271872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 58us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.608581:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2110 00000100:00100000:0.0:1769074939.608603:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271488 00000100:00100000:0.0:1769074939.608606:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271488 00000100:00100000:0.0:1769074939.608649:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272000 00000100:00100000:0.0:1769074939.608653:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272000 00000100:00100000:0.0:1769074939.608671:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271616 00000100:00100000:0.0:1769074939.608674:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271616 00000100:00100000:0.0:1769074939.608693:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272128 00000100:00100000:0.0:1769074939.608696:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272128 00000100:00100000:0.0:1769074939.608876:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3166 00000100:00100000:0.0:1769074939.608884:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+37:2418:x1855007616271488:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.608930:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+37:2418:x1855007616271488:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 46us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.608937:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3166 00000100:00100000:0.0:1769074939.608951:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3167 00000100:00100000:0.0:1769074939.608958:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616272000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.608983:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616272000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 25us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.608989:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3167 00000100:00100000:0.0:1769074939.609002:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3168 00000100:00100000:0.0:1769074939.609008:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:2418:x1855007616271616:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.609032:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+464:2418:x1855007616271616:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.609038:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3168 00000100:00100000:0.0:1769074939.609049:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3169 00000100:00100000:0.0:1769074939.609055:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2418:x1855007616272128:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.609074:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2418:x1855007616272128:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 20us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.609080:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3169 00000100:00100000:0.0:1769074939.609099:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616271360 00000100:00100000:0.0:1769074939.609102:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616271360 00000100:00100000:0.0:1769074939.609126:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 279 00000100:00100000:0.0:1769074939.609132:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616271360:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074939.609153:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616271360:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 21us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074939.609158:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 279 00000100:00080000:0.0:1769074939.609196:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1769074939.609199:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1769074939.609202:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1769074939.609204:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074939.830731:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626653440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769074939.830809:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074939.830880:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626653440 00000100:00100000:2.0:1769074939.830887:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626653440 00000100:00100000:2.0:1769074939.830945:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1769074939.830953:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626653440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1769074939.830978:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2924544 granted 492742720 pending 344064 free 3764301824 avail 3532779520 00000100:00100000:2.0:1769074939.831016:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626653440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074939.831023:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00080000:2.0:1769074939.831044:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074939.831076:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626653440:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1769074940.090074:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1769074940.854313:0:7437:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294969213 is committed 00010000:00010000:1.0:1769074940.857485:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857501:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857509:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857515:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3c00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.857519:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857526:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857557:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa077667a (ffff91604464ee00) 00010000:00010000:1.0:1769074940.857560:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.857564:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857570:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3c00/0x557988ac98fed43d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa077667a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857610:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857617:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857624:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857629:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef000 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.857632:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857638:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857645:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe72f5e5 (ffff916052ae5f00) 00010000:00010000:1.0:1769074940.857648:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.857651:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857656:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef000/0x557988ac98fed4ec lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe72f5e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857670:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857676:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857692:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857696:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.857699:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857705:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857712:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x2e09b43e (ffff91604464e500) 00010000:00010000:1.0:1769074940.857714:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.857718:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857723:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3400/0x557988ac98fed5b0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x2e09b43e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.857736:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857742:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857747:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857751:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.857754:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857946:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857955:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xa84c5812 (ffff916052ae5c00) 00010000:00010000:1.0:1769074940.857957:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.857960:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857966:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef200/0x557988ac98fed689 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xa84c5812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857981:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857987:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857992:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.857996:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ef400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.857999:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858004:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858011:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xd0fae707 (ffff91604faeb000) 00010000:00010000:1.0:1769074940.858013:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858016:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858020:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ef400/0x557988ac98fed738 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xd0fae707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858032:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858037:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858043:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858202:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1eea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858205:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858212:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858220:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb3321465 (ffff91604faebf00) 00010000:00010000:1.0:1769074940.858222:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858225:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858232:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1eea00/0x557988ac98fed7fc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb3321465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858248:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858254:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858259:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858265:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ebfac00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858267:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858273:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858278:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x950fedce (ffff91604f1ad000) 00010000:00010000:1.0:1769074940.858280:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858283:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858288:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ebfac00/0x557988ac98fed8ab lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x950fedce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858300:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858306:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858311:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858317:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858320:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858325:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858332:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x5f135090 (ffff91604464e600) 00010000:00010000:1.0:1769074940.858335:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858337:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858343:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3800/0x557988ac98fed96f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x5f135090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858356:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858361:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858366:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858373:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f3d3a00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858376:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858381:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858388:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x9220af6 (ffff91604464e800) 00010000:00010000:1.0:1769074940.858390:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858392:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858397:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f3d3a00/0x557988ac98feda48 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x9220af6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858409:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858413:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858416:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858419:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e095600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858420:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858423:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858427:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x8eac725e (ffff916052aa4500) 00010000:00010000:1.0:1769074940.858429:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858431:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858434:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e095600/0x557988ac98fedb21 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x8eac725e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858442:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858445:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858448:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858451:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f1ee800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858453:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858456:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858459:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x17ca2ee2 (ffff91604f1adf00) 00010000:00010000:1.0:1769074940.858460:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858462:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858464:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f1ee800/0x557988ac98fedbe5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x17ca2ee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858472:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858475:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858478:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858481:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9f400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858483:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858487:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858493:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x4a2b8536 (ffff91604ec89800) 00010000:00010000:1.0:1769074940.858495:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858497:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858502:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9f400/0x557988ac98fedca9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x4a2b8536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858517:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858522:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858526:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858931:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a200 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858935:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858941:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858951:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x721aa6ae (ffff91604ec89f00) 00010000:00010000:1.0:1769074940.858953:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.858955:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858961:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a200/0x557988ac98fedd6d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x721aa6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.858976:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858982:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858987:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858991:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12a600 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.858993:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.858999:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859006:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x703de786 (ffff91604ec89600) 00010000:00010000:1.0:1769074940.859009:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859011:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859016:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12a600/0x557988ac98fede31 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x703de786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859028:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859033:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859038:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859043:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.859046:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859061:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859068:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x37007d72 (ffff91604ec89700) 00010000:00010000:1.0:1769074940.859071:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859074:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859079:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b800/0x557988ac98fedee0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x37007d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859096:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859101:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859106:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859110:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12ae00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.859113:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859119:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859126:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb0555f98 (ffff916174a68a00) 00010000:00010000:1.0:1769074940.859137:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859140:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859146:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12ae00/0x557988ac98fedf8f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb0555f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859160:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859165:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859170:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859174:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604ea9e800 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.859177:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859181:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859187:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xb91b273d (ffff91604e63cd00) 00010000:00010000:1.0:1769074940.859189:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859191:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859196:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604ea9e800/0x557988ac98fee03e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xb91b273d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859208:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859212:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859217:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859221:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604f12b400 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.859223:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859228:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859233:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x6282df54 (ffff91604f135700) 00010000:00010000:1.0:1769074940.859235:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859237:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859241:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604f12b400/0x557988ac98fee0ed lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x6282df54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25310 initiator: MDT1 00010000:00010000:1.0:1769074940.859253:0:3640:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859258:0:3640:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859263:0:3640:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859271:0:3640:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff91604e71ea00 already unused, calling callback (ffffffffc1784550) 00010000:00010000:1.0:1769074940.859273:0:3640:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859279:0:3640:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859286:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0xe22679c (ffff916052aa4800) 00010000:00010000:1.0:1769074940.859288:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1769074940.859291:0:3640:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1769074940.859295:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff91604e71ea00/0x557988ac98fee1c6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0xe22679c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1769074940.980058:0:44354:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1769074940.980067:0:44354:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769074940.980612:0:44354:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1769074940.980622:0:44354:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1769074941.108701:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074941.164456:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164519:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164577:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164611:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164665:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164676:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164707:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164728:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164744:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074941.164766:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272256 00000100:00100000:0.0:1769074941.164775:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272256 00002000:00100000:0.0:1769074941.164832:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7a:0x0] (0->157) req@ffff916181770e00 x1855007616272256/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.164843:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181770e00 with x1855007616272256 ext(0->157) 00002000:00010000:0.0:1769074941.164849:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181770e00 00000100:00100000:0.0:1769074941.164865:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272512 00000100:00100000:0.0:1769074941.164867:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272512 00002000:00100000:0.0:1769074941.164879:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7b:0x0] (0->157) req@ffff916181772300 x1855007616272512/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.164899:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181772300 with x1855007616272512 ext(0->157) 00002000:00010000:0.0:1769074941.164902:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181772300 00000100:00100000:0.0:1769074941.164911:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 728 00000100:00100000:0.0:1769074941.164919:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2420:x1855007616272256:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074941.165340:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272768 00000100:00100000:0.0:1769074941.165345:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272768 00002000:00100000:0.0:1769074941.165364:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7c:0x0] (0->157) req@ffff916181771180 x1855007616272768/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165373:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181771180 with x1855007616272768 ext(0->157) 00002000:00010000:0.0:1769074941.165377:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181771180 00000100:00100000:0.0:1769074941.165385:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273024 00000100:00100000:0.0:1769074941.165388:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273024 00002000:00100000:0.0:1769074941.165400:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7d:0x0] (0->157) req@ffff916181773b80 x1855007616273024/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165408:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773b80 with x1855007616273024 ext(0->157) 00002000:00010000:0.0:1769074941.165411:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773b80 00000100:00100000:0.0:1769074941.165417:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273280 00000100:00100000:0.0:1769074941.165420:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273280 00002000:00100000:0.0:1769074941.165431:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7e:0x0] (0->157) req@ffff916181773800 x1855007616273280/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165440:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773800 with x1855007616273280 ext(0->157) 00002000:00010000:0.0:1769074941.165444:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773800 00000100:00100000:0.0:1769074941.165450:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273536 00000100:00100000:0.0:1769074941.165452:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273536 00002000:00100000:0.0:1769074941.165465:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7f:0x0] (0->157) req@ffff91617fa3ce00 x1855007616273536/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165471:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ce00 with x1855007616273536 ext(0->157) 00002000:00010000:0.0:1769074941.165475:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3ce00 00000100:00100000:0.0:1769074941.165481:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273792 00000100:00100000:0.0:1769074941.165483:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273792 00002000:00100000:0.0:1769074941.165493:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x80:0x0] (0->157) req@ffff91617fa3c700 x1855007616273792/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165500:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c700 with x1855007616273792 ext(0->157) 00002000:00010000:0.0:1769074941.165503:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3c700 00000100:00100000:0.0:1769074941.165508:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274048 00000100:00100000:0.0:1769074941.165511:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274048 00002000:00100000:0.0:1769074941.165520:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x81:0x0] (0->157) req@ffff91617fa3d180 x1855007616274048/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165555:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3d180 with x1855007616274048 ext(0->157) 00002000:00010000:0.0:1769074941.165558:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3d180 00000100:00100000:0.0:1769074941.165565:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274304 00000100:00100000:0.0:1769074941.165568:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274304 00002000:00100000:0.0:1769074941.165579:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x82:0x0] (0->157) req@ffff91617fa3ea00 x1855007616274304/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165586:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ea00 with x1855007616274304 ext(0->157) 00002000:00010000:0.0:1769074941.165589:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3ea00 00000100:00100000:0.0:1769074941.165594:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272384 00000100:00100000:0.0:1769074941.165596:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272384 00002000:00100000:0.0:1769074941.165612:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7b:0x0] (0->157) req@ffff91617fa3ca80 x1855007616272384/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165618:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ca80 with x1855007616272384 ext(0->157) 00002000:00010000:0.0:1769074941.165621:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3ca80 00000100:00100000:0.0:1769074941.165626:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272640 00000100:00100000:0.0:1769074941.165629:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272640 00002000:00100000:0.0:1769074941.165640:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7c:0x0] (0->157) req@ffff91617fa3f100 x1855007616272640/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165648:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3f100 with x1855007616272640 ext(0->157) 00002000:00010000:0.0:1769074941.165651:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3f100 00000100:00100000:0.0:1769074941.165656:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616272896 00000100:00100000:0.0:1769074941.165659:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616272896 00002000:00100000:0.0:1769074941.165670:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7d:0x0] (0->157) req@ffff91617fa3df80 x1855007616272896/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165677:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3df80 with x1855007616272896 ext(0->157) 00002000:00010000:0.0:1769074941.165680:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3df80 00000100:00100000:0.0:1769074941.165685:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273152 00000100:00100000:0.0:1769074941.165688:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273152 00002000:00100000:0.0:1769074941.165698:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7e:0x0] (0->157) req@ffff91617fa3e300 x1855007616273152/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165710:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3e300 with x1855007616273152 ext(0->157) 00002000:00010000:0.0:1769074941.165714:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3e300 00000100:00100000:0.0:1769074941.165719:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273408 00000100:00100000:0.0:1769074941.165721:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273408 00002000:00100000:0.0:1769074941.165732:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x7f:0x0] (0->157) req@ffff91617fa3e680 x1855007616273408/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165739:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3e680 with x1855007616273408 ext(0->157) 00002000:00010000:0.0:1769074941.165742:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3e680 00000100:00100000:0.0:1769074941.165747:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273664 00000100:00100000:0.0:1769074941.165749:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273664 00002000:00100000:0.0:1769074941.165759:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x80:0x0] (0->157) req@ffff91617fa3c380 x1855007616273664/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165765:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c380 with x1855007616273664 ext(0->157) 00002000:00010000:0.0:1769074941.165768:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3c380 00000100:00100000:0.0:1769074941.165773:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616273920 00000100:00100000:0.0:1769074941.165776:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616273920 00002000:00100000:0.0:1769074941.165787:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x81:0x0] (0->157) req@ffff91617fa3d880 x1855007616273920/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165795:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3d880 with x1855007616273920 ext(0->157) 00002000:00010000:0.0:1769074941.165797:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3d880 00000100:00100000:0.0:1769074941.165804:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274176 00000100:00100000:0.0:1769074941.165806:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274176 00002000:00100000:0.0:1769074941.165817:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x82:0x0] (0->157) req@ffff91617fa3c000 x1855007616274176/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165824:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c000 with x1855007616274176 ext(0->157) 00002000:00010000:0.0:1769074941.165828:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3c000 00000100:00100000:0.0:1769074941.165833:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274432 00000100:00100000:0.0:1769074941.165835:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274432 00002000:00100000:0.0:1769074941.165844:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x83:0x0] (0->157) req@ffff91617fa3fb80 x1855007616274432/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.165851:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3fb80 with x1855007616274432 ext(0->157) 00002000:00010000:0.0:1769074941.165854:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3fb80 00000100:00100000:0.0:1769074941.165863:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 729 00000100:00100000:0.0:1769074941.165870:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616272512:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.167432:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 730 00000100:00100000:1.0:1769074941.167452:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616272768:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.168873:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 731 00000100:00100000:2.0:1769074941.168901:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:2420:x1855007616273024:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.169389:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 732 00000100:00100000:2.0:1769074941.169398:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+252:2420:x1855007616273280:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.169572:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 733 00000100:00100000:2.0:1769074941.169579:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+254:2420:x1855007616273536:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.169727:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 734 00000100:00100000:2.0:1769074941.169734:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:2420:x1855007616273792:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.171496:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+258:2420:x1855007616272768:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4040us (6965us total) trans 4294967882 rc 0/0 00000100:00100000:1.0:1769074941.171509:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 730 00002000:00100000:1.0:1769074941.171521:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x7c:0x0] (0->157) req@ffff916181771180 x1855007616272768/t4294967882(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.171552:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181771180 with x1855007616272768 ext(0->157) 00002000:00010000:1.0:1769074941.171558:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181771180 00000100:00100000:1.0:1769074941.171592:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 735 00000100:00100000:1.0:1769074941.171602:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+257:2420:x1855007616274048:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.173736:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+259:2420:x1855007616273024:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4843us (9164us total) trans 4294967883 rc 0/0 00000100:00100000:2.0:1769074941.173749:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 731 00002000:00100000:2.0:1769074941.173761:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x7d:0x0] (0->157) req@ffff916181773b80 x1855007616273024/t4294967883(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.173770:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773b80 with x1855007616273024 ext(0->157) 00002000:00010000:2.0:1769074941.173777:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773b80 00000100:00100000:2.0:1769074941.173808:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 736 00000100:00100000:2.0:1769074941.173818:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+258:2420:x1855007616274304:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.174202:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+260:2420:x1855007616273280:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4804us (9622us total) trans 4294967884 rc 0/0 00000100:00100000:2.0:1769074941.174210:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 732 00002000:00100000:2.0:1769074941.174218:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x7e:0x0] (0->157) req@ffff916181773800 x1855007616273280/t4294967884(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.174227:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773800 with x1855007616273280 ext(0->157) 00002000:00010000:2.0:1769074941.174231:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773800 00000100:00100000:2.0:1769074941.174249:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 737 00000100:00100000:2.0:1769074941.174257:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2420:x1855007616272384:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.174505:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+259:2420:x1855007616273536:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4924us (9907us total) trans 4294967885 rc 0/0 00000100:00100000:2.0:1769074941.174512:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 733 00002000:00100000:2.0:1769074941.174519:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x7f:0x0] (0->157) req@ffff91617fa3ce00 x1855007616273536/t4294967885(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.174527:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ce00 with x1855007616273536 ext(0->157) 00002000:00010000:2.0:1769074941.174553:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3ce00 00000100:00100000:2.0:1769074941.174570:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 738 00000100:00100000:2.0:1769074941.174576:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2420:x1855007616272640:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.174756:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+258:2420:x1855007616273792:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5021us (10142us total) trans 4294967886 rc 0/0 00000100:00100000:2.0:1769074941.174763:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 734 00002000:00100000:2.0:1769074941.174769:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x80:0x0] (0->157) req@ffff91617fa3c700 x1855007616273792/t4294967886(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.174778:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c700 with x1855007616273792 ext(0->157) 00002000:00010000:2.0:1769074941.174782:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3c700 00000100:00100000:2.0:1769074941.174797:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 739 00000100:00100000:2.0:1769074941.174804:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2420:x1855007616272896:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.175020:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+257:2420:x1855007616274048:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3420us (10390us total) trans 4294967887 rc 0/0 00000100:00100000:1.0:1769074941.175028:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 735 00002000:00100000:1.0:1769074941.175035:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x81:0x0] (0->157) req@ffff91617fa3d180 x1855007616274048/t4294967887(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.175043:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3d180 with x1855007616274048 ext(0->157) 00002000:00010000:1.0:1769074941.175047:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3d180 00000100:00100000:1.0:1769074941.175062:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 740 00000100:00100000:1.0:1769074941.175070:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2420:x1855007616273152:12345-192.168.204.32@tcp:4:cp.0 00000100:00080000:0.0:1769074941.176609:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1769074941.176617:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074941.177165:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:2420:x1855007616272256:12345-192.168.204.32@tcp:4:cp.0 Request processed in 12238us (12712us total) trans 4294967881 rc 0/0 00000100:00100000:1.0:1769074941.177177:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 728 00002000:00100000:1.0:1769074941.177189:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7a:0x0] (0->157) req@ffff916181770e00 x1855007616272256/t4294967881(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.177200:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181770e00 with x1855007616272256 ext(0->157) 00002000:00010000:1.0:1769074941.177205:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181770e00 00000100:00100000:1.0:1769074941.177232:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 741 00000100:00100000:1.0:1769074941.177242:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616273408:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.180079:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616273152:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5000us (15380us total) trans 4294967895 rc 0/0 00000100:00100000:1.0:1769074941.180094:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 740 00002000:00100000:1.0:1769074941.180106:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x7e:0x0] (0->157) req@ffff91617fa3e300 x1855007616273152/t4294967895(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.180115:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3e300 with x1855007616273152 ext(0->157) 00002000:00010000:1.0:1769074941.180122:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3e300 00000100:00100000:1.0:1769074941.180156:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 742 00000100:00100000:1.0:1769074941.180166:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616273664:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.180847:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2420:x1855007616273408:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3604us (16144us total) trans 4294967896 rc 0/0 00000100:00100000:1.0:1769074941.180857:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 741 00002000:00100000:1.0:1769074941.180864:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x7f:0x0] (0->157) req@ffff91617fa3e680 x1855007616273408/t4294967896(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.180874:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3e680 with x1855007616273408 ext(0->157) 00002000:00010000:1.0:1769074941.180878:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3e680 00000100:00100000:1.0:1769074941.180912:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 743 00000100:00100000:1.0:1769074941.180919:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616273920:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.181956:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616272640:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7373us (17282us total) trans 4294967894 rc 0/0 00000100:00100000:2.0:1769074941.181966:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 738 00002000:00100000:2.0:1769074941.181975:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x7c:0x0] (0->157) req@ffff91617fa3f100 x1855007616272640/t4294967894(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.181990:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3f100 with x1855007616272640 ext(0->157) 00002000:00010000:2.0:1769074941.181995:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3f100 00000100:00100000:2.0:1769074941.182019:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 744 00000100:00100000:2.0:1769074941.182027:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2420:x1855007616274176:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.182228:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2420:x1855007616272384:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7971us (17570us total) trans 4294967893 rc 0/0 00000100:00100000:1.0:1769074941.182236:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 737 00002000:00100000:1.0:1769074941.182242:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x7b:0x0] (0->157) req@ffff91617fa3ca80 x1855007616272384/t4294967893(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.182250:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ca80 with x1855007616272384 ext(0->157) 00002000:00010000:1.0:1769074941.182255:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3ca80 00000100:00100000:1.0:1769074941.182270:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 745 00000100:00100000:1.0:1769074941.182277:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616274432:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.187393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.187508:0:8409:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1769074941.187520:0:8409:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_io00_009' 00000100:00100000:2.0:1769074941.188272:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+251:2420:x1855007616272896:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13461us (23588us total) trans 4294967897 rc 0/0 00000100:00100000:2.0:1769074941.188284:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 739 00002000:00100000:2.0:1769074941.188297:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x7d:0x0] (0->157) req@ffff91617fa3df80 x1855007616272896/t4294967897(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.188308:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3df80 with x1855007616272896 ext(0->157) 00002000:00010000:2.0:1769074941.188314:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3df80 00000100:00100000:2.0:1769074941.188345:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274560 00000100:00100000:2.0:1769074941.188353:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274560 00002000:00100000:2.0:1769074941.188385:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x84:0x0] (0->157) req@ffff9160413b7100 x1855007616274560/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.188393:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b7100 with x1855007616274560 ext(0->157) 00002000:00010000:2.0:1769074941.188396:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b7100 00000100:00100000:2.0:1769074941.188420:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 746 00000100:00100000:2.0:1769074941.188429:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:2420:x1855007616274560:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074941.188755:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+256:2420:x1855007616274304:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14938us (24111us total) trans 4294967888 rc 0/0 00000100:00100000:2.0:1769074941.188763:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 736 00002000:00100000:2.0:1769074941.188770:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x82:0x0] (0->157) req@ffff91617fa3ea00 x1855007616274304/t4294967888(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.188778:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3ea00 with x1855007616274304 ext(0->157) 00002000:00010000:2.0:1769074941.188782:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fa3ea00 00000100:00100000:1.0:1769074941.193802:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:2420:x1855007616273664:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13630us (29084us total) trans 4294967900 rc 0/0 00000100:00100000:1.0:1769074941.193817:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 742 00002000:00100000:1.0:1769074941.193830:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x80:0x0] (0->157) req@ffff91617fa3c380 x1855007616273664/t4294967900(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.193840:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c380 with x1855007616273664 ext(0->157) 00002000:00010000:1.0:1769074941.193846:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3c380 00000100:00100000:0.0:1769074941.194023:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+259:2420:x1855007616274560:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5593us (6639us total) trans 4294967889 rc 0/0 00000100:00100000:0.0:1769074941.194032:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 746 00002000:00100000:0.0:1769074941.194039:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x84:0x0] (0->157) req@ffff9160413b7100 x1855007616274560/t4294967889(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.194052:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b7100 with x1855007616274560 ext(0->157) 00002000:00010000:0.0:1769074941.194056:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b7100 00000100:00100000:0.0:1769074941.194113:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+249:2420:x1855007616274432:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11835us (29367us total) trans 4294967899 rc 0/0 00000100:00100000:0.0:1769074941.194120:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 745 00002000:00100000:0.0:1769074941.194125:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x83:0x0] (0->157) req@ffff91617fa3fb80 x1855007616274432/t4294967899(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.194133:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3fb80 with x1855007616274432 ext(0->157) 00002000:00010000:0.0:1769074941.194137:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3fb80 00000100:00100000:0.0:1769074941.194179:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+258:2420:x1855007616272512:12345-192.168.204.32@tcp:4:cp.0 Request processed in 28308us (29681us total) trans 4294967890 rc 0/0 00000100:00100000:0.0:1769074941.194187:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 729 00002000:00100000:0.0:1769074941.194191:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x7b:0x0] (0->157) req@ffff916181772300 x1855007616272512/t4294967890(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.194199:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181772300 with x1855007616272512 ext(0->157) 00002000:00010000:0.0:1769074941.194203:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181772300 00000001:00080000:0.0:1769074941.194932:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967888 is committed 00000100:00100000:1.0:1769074941.195280:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616273920:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14358us (30557us total) trans 4294967901 rc 0/0 00000100:00100000:1.0:1769074941.195288:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 743 00002000:00100000:1.0:1769074941.195297:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x81:0x0] (0->157) req@ffff91617fa3d880 x1855007616273920/t4294967901(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.195305:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3d880 with x1855007616273920 ext(0->157) 00002000:00010000:1.0:1769074941.195310:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3d880 00000100:00100000:2.0:1769074941.196988:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2420:x1855007616274176:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14953us (32249us total) trans 4294967898 rc 0/0 00000100:00100000:2.0:1769074941.197002:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 744 00002000:00100000:2.0:1769074941.197015:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x82:0x0] (0->157) req@ffff91617fa3c000 x1855007616274176/t4294967898(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074941.197025:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fa3c000 with x1855007616274176 ext(0->157) 00002000:00010000:2.0:1769074941.197031:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fa3c000 00000100:00100000:1.0:1769074941.200233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.200439:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274816 00000100:00100000:1.0:1769074941.200448:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274816 00002000:00100000:1.0:1769074941.200493:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x83:0x0] (0->157) req@ffff9160413b4a80 x1855007616274816/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200505:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4a80 with x1855007616274816 ext(0->157) 00002000:00010000:1.0:1769074941.200512:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b4a80 00000100:00100000:1.0:1769074941.200542:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275072 00000100:00100000:1.0:1769074941.200545:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275072 00002000:00100000:1.0:1769074941.200556:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x85:0x0] (0->157) req@ffff9160413b6300 x1855007616275072/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200564:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b6300 with x1855007616275072 ext(0->157) 00002000:00010000:1.0:1769074941.200568:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b6300 00000100:00100000:1.0:1769074941.200577:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274688 00000100:00100000:1.0:1769074941.200579:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274688 00002000:00100000:1.0:1769074941.200588:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x86:0x0] (0->157) req@ffff9160413b4e00 x1855007616274688/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200595:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4e00 with x1855007616274688 ext(0->157) 00002000:00010000:1.0:1769074941.200599:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b4e00 00000100:00100000:1.0:1769074941.200606:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616274944 00000100:00100000:1.0:1769074941.200608:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616274944 00002000:00100000:1.0:1769074941.200617:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x87:0x0] (0->157) req@ffff9160413b5180 x1855007616274944/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200624:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b5180 with x1855007616274944 ext(0->157) 00002000:00010000:1.0:1769074941.200627:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b5180 00000100:00100000:1.0:1769074941.200631:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275328 00000100:00100000:1.0:1769074941.200633:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275328 00002000:00100000:1.0:1769074941.200643:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x85:0x0] (0->157) req@ffff9160413b4000 x1855007616275328/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200650:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4000 with x1855007616275328 ext(0->157) 00002000:00010000:1.0:1769074941.200653:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b4000 00000100:00100000:1.0:1769074941.200657:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275200 00000100:00100000:1.0:1769074941.200660:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275200 00002000:00100000:1.0:1769074941.200668:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x86:0x0] (0->157) req@ffff9160413b7800 x1855007616275200/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.200675:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b7800 with x1855007616275200 ext(0->157) 00002000:00010000:1.0:1769074941.200678:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b7800 00000100:00100000:1.0:1769074941.200685:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 747 00000100:00100000:1.0:1769074941.200692:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2420:x1855007616274816:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.201084:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 748 00000100:00100000:1.0:1769074941.201090:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2420:x1855007616275072:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.201223:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 749 00000100:00100000:1.0:1769074941.201229:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2420:x1855007616274688:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.201361:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 750 00000100:00100000:1.0:1769074941.201367:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616274944:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.201633:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 751 00000100:00100000:1.0:1769074941.201639:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2420:x1855007616275328:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074941.204292:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 752 00000100:00100000:0.0:1769074941.204308:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+250:2420:x1855007616275200:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074941.205834:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2420:x1855007616275072:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4733us (5480us total) trans 4294967892 rc 0/0 00000100:00100000:1.0:1769074941.205847:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 748 00002000:00100000:1.0:1769074941.205859:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x85:0x0] (0->157) req@ffff9160413b6300 x1855007616275072/t4294967892(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.205870:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b6300 with x1855007616275072 ext(0->157) 00002000:00010000:1.0:1769074941.205877:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b6300 00000100:00100000:0.0:1769074941.206852:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+252:2420:x1855007616275200:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2544us (6426us total) trans 4294967903 rc 0/0 00000100:00100000:0.0:1769074941.206863:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 752 00002000:00100000:0.0:1769074941.206873:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x86:0x0] (0->157) req@ffff9160413b7800 x1855007616275200/t4294967903(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1769074941.207324:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616274688:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6092us (6954us total) trans 4294967893 rc 0/0 00000100:00100000:1.0:1769074941.207333:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 749 00002000:00100000:1.0:1769074941.207340:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x86:0x0] (0->157) req@ffff9160413b4e00 x1855007616274688/t4294967893(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.207349:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4e00 with x1855007616274688 ext(0->157) 00002000:00010000:1.0:1769074941.207354:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b4e00 00000100:00100000:1.0:1769074941.207399:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2420:x1855007616274944:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6032us (7016us total) trans 4294967894 rc 0/0 00000100:00100000:1.0:1769074941.207406:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 750 00002000:00100000:1.0:1769074941.207412:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x87:0x0] (0->157) req@ffff9160413b5180 x1855007616274944/t4294967894(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.207420:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b5180 with x1855007616274944 ext(0->157) 00002000:00010000:1.0:1769074941.207424:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b5180 00000100:00100000:1.0:1769074941.207467:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616274816:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6773us (7240us total) trans 4294967891 rc 0/0 00000100:00100000:1.0:1769074941.207474:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 747 00002000:00100000:1.0:1769074941.207479:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x83:0x0] (0->157) req@ffff9160413b4a80 x1855007616274816/t4294967891(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.207486:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4a80 with x1855007616274816 ext(0->157) 00002000:00010000:1.0:1769074941.207490:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160413b4a80 00000100:00100000:1.0:1769074941.207564:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+252:2420:x1855007616275328:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5924us (7164us total) trans 4294967902 rc 0/0 00000100:00100000:1.0:1769074941.207570:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 751 00002000:00100000:1.0:1769074941.207575:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x85:0x0] (0->157) req@ffff9160413b4000 x1855007616275328/t4294967902(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.207582:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b4000 with x1855007616275328 ext(0->157) 00002000:00010000:1.0:1769074941.207585:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b4000 00002000:00100000:0.0:1769074941.208607:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b7800 with x1855007616275200 ext(0->157) 00002000:00010000:0.0:1769074941.208613:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b7800 00000001:00080000:0.0:1769074941.216556:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967897 is committed 00000100:00100000:1.0:1769074941.222723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.222773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074941.222810:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275584 00000100:00100000:1.0:1769074941.222822:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275584 00002000:00100000:1.0:1769074941.222873:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x87:0x0] (0->157) req@ffff9160413b6a00 x1855007616275584/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.222898:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b6a00 with x1855007616275584 ext(0->157) 00002000:00010000:1.0:1769074941.222904:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b6a00 00000100:00100000:1.0:1769074941.222926:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275456 00000100:00100000:1.0:1769074941.222930:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275456 00002000:00100000:1.0:1769074941.222943:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x84:0x0] (0->157) req@ffff91604f180a80 x1855007616275456/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/0 e 0 to 0 dl 1769074952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.222951:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f180a80 with x1855007616275456 ext(0->157) 00002000:00010000:1.0:1769074941.222955:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f180a80 00000100:00100000:1.0:1769074941.222974:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 753 00000100:00100000:1.0:1769074941.222982:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616275584:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074941.223173:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 754 00000100:00100000:0.0:1769074941.223184:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2420:x1855007616275456:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074941.224793:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2420:x1855007616275456:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1603us (2009us total) trans 4294967904 rc 0/0 00000100:00100000:0.0:1769074941.224805:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 754 00002000:00100000:0.0:1769074941.224814:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x84:0x0] (0->157) req@ffff91604f180a80 x1855007616275456/t4294967904(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074941.224824:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f180a80 with x1855007616275456 ext(0->157) 00002000:00010000:0.0:1769074941.224829:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f180a80 00000100:00100000:1.0:1769074941.225244:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160413b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2420:x1855007616275584:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2260us (2530us total) trans 4294967905 rc 0/0 00000100:00100000:1.0:1769074941.225252:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 753 00002000:00100000:1.0:1769074941.225258:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x87:0x0] (0->157) req@ffff9160413b6a00 x1855007616275584/t4294967905(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:477/0 lens 648/448 e 0 to 0 dl 1769074952 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074941.225271:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160413b6a00 with x1855007616275584 ext(0->157) 00002000:00010000:1.0:1769074941.225275:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160413b6a00 00000100:00100000:0.0:1769074941.363894:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626653696:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.363998:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.364083:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626654208:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364334:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.364361:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626654720:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364385:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.364422:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1769074941.364428:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626653824:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364454:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.364473:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626654336:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074941.364494:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626653952:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364514:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626654848:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.364525:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.364561:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074941.364581:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626654464:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.364606:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654208 00000100:00100000:0.0:1769074941.364617:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654208 00000100:00100000:0.0:1769074941.364684:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654848 00000100:00100000:0.0:1769074941.364687:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654848 00000100:00100000:0.0:1769074941.364714:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:0.0:1769074941.364723:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626654208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.364751:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626653568:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.364795:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.365403:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626654208:12345-0@lo:400:kworker.0 Request processed in 678us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.365414:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:0.0:1769074941.365444:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:0.0:1769074941.365453:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626654848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.365488:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626654848:12345-0@lo:400:kworker.0 Request processed in 38us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.365493:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:0.0:1769074941.365516:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626653696 00000100:00100000:0.0:1769074941.365520:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626653696 00000100:00100000:0.0:1769074941.365569:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654720 00000100:00100000:0.0:1769074941.365572:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654720 00000100:00100000:0.0:1769074941.365584:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1769074941.365590:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626653696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.365626:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626653696:12345-0@lo:400:kworker.0 Request processed in 36us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.365632:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1769074941.365644:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1769074941.365650:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626654720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.365676:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626654720:12345-0@lo:400:kworker.0 Request processed in 27us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.365680:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1769074941.365701:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626653824 00000100:00100000:0.0:1769074941.365704:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626653824 00000100:00100000:0.0:1769074941.365734:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654336 00000100:00100000:0.0:1769074941.365736:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654336 00000100:00100000:0.0:1769074941.365906:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626653952 00000100:00100000:0.0:1769074941.365911:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626653952 00000100:00100000:0.0:1769074941.365939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:0.0:1769074941.365945:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626653824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.365979:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626653824:12345-0@lo:400:kworker.0 Request processed in 34us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.365986:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:0.0:1769074941.365999:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:0.0:1769074941.366004:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626654336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.366029:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626654336:12345-0@lo:400:kworker.0 Request processed in 25us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.366029:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.366034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:0.0:1769074941.366044:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654464 00000100:00100000:0.0:1769074941.366048:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654464 00000100:00100000:2.0:1769074941.366068:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626654976:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074941.366140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1769074941.366149:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626653952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366187:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626653952:12345-0@lo:400:kworker.0 Request processed in 40us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.366194:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1769074941.366272:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626653952:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366365:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626653568 00000100:00100000:2.0:1769074941.366369:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626653568 00000100:00100000:2.0:1769074941.366400:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1769074941.366405:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626653568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366438:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626653568:12345-0@lo:400:kworker.0 Request processed in 33us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.366445:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1769074941.366467:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:0.0:1769074941.366473:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626654464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366477:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654976 00000100:00100000:2.0:1769074941.366481:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654976 00000100:00100000:0.0:1769074941.366508:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626654464:12345-0@lo:400:kworker.0 Request processed in 35us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.366508:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1769074941.366514:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:2.0:1769074941.366514:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626654976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.366563:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626654976:12345-0@lo:400:kworker.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.366570:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1769074941.367722:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1769074941.367743:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626655232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074941.367816:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1769074941.368060:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1769074941.368068:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1769074941.368072:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1769074941.368075:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074941.368100:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655232 00000100:00100000:2.0:1769074941.368108:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655232 00000100:00100000:2.0:1769074941.368163:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1769074941.368172:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626655232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1769074941.368213:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:2.0:1769074941.368268:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1855007626655232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074941.368275:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1769074941.368332:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626654464:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368350:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626654976:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368394:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626653824:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368413:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626654336:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368426:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626654848:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368440:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626653696:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368451:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626654208:0@lo:400:kworker.0 00000100:00100000:2.0:1769074941.368462:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626654720:0@lo:400:kworker.0 00000100:00100000:0.0:1769074941.368940:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1855007626655232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074941.371551:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1769074941.371595:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626655360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074941.371684:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074941.371767:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655360 00000100:00100000:0.0:1769074941.371776:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655360 00000100:00100000:0.0:1769074941.371832:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1769074941.371855:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626655360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1769074941.371913:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:0.0:1769074941.371972:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626655360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074941.371978:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1769074941.372039:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626655360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1769074941.373556:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626655488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1769074941.373646:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074941.374130:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655488 00000100:00100000:3.0:1769074941.374142:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655488 00000100:00100000:3.0:1769074941.374216:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1769074941.374227:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626655488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074941.374258:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2809856 granted 492132416 pending 172032 free 3915513856 avail 3683303424 00000100:00100000:3.0:1769074941.374344:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626655488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074941.374354:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1769074941.374412:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626655488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769074941.375670:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626653568:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.375689:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1855007626654080:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.375747:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074941.375768:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626654592:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.375799:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074941.375826:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617fb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626655104:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.375861:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074941.375949:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654592 00000100:00100000:1.0:1769074941.375957:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654592 00000100:00100000:1.0:1769074941.376017:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1769074941.376025:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626654592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.376090:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626654592:12345-0@lo:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074941.376098:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1769074941.376125:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626654080 00000100:00100000:1.0:1769074941.376129:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626654080 00000100:00100000:1.0:1769074941.376170:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655104 00000100:00100000:1.0:1769074941.376184:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655104 00000100:00100000:1.0:1769074941.376206:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:1.0:1769074941.376212:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1855007626654080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.376247:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1855007626654080:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074941.376255:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00100000:1.0:1769074941.376268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:1.0:1769074941.376273:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626655104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.376300:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626655104:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074941.376306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00080000:1.0:1769074941.376324:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1769074941.376330:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074941.376355:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1855007626654080:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.376366:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626654592:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.376374:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617fb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626655104:0@lo:400:kworker.0 00000100:00100000:1.0:1769074941.875802:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626655616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769074941.875905:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074941.876020:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655616 00000100:00100000:1.0:1769074941.876029:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655616 00000100:00100000:1.0:1769074941.876097:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1769074941.876107:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626655616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1769074941.876135:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2809856 granted 492132416 pending 172032 free 3915513856 avail 3683303424 00000100:00100000:1.0:1769074941.876187:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626655616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074941.876194:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1769074941.876253:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626655616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074941.876918:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916043580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626655744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769074941.876968:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074941.877167:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655744 00000100:00100000:1.0:1769074941.877174:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655744 00000100:00100000:1.0:1769074941.877214:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1769074941.877222:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626655744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1769074941.877247:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2867200 granted 492255296 pending 229376 free 3764248576 avail 3532726272 00000100:00100000:1.0:1769074941.877342:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626655744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074941.877349:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1769074941.885353:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916043580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626655744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1769074942.131990:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1769074942.900185:0:44404:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1769074942.900200:0:44404:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1769074942.902111:0:44404:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1769074942.902135:0:44404:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1769074943.155754:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1769074944.056746:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1769074944.056755:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769074944.059928:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1769074944.059946:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1769074944.180974:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1769074944.441162:0:37098:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934948 is committed 00000100:00100000:1.0:1769074944.720977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721044:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074944.721190:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275712 00000100:00100000:1.0:1769074944.721199:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275712 00000100:00100000:1.0:1769074944.721252:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 281 00000100:00100000:1.0:1769074944.721262:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616275712:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721340:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616275712:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 78us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721348:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 281 00000100:00100000:1.0:1769074944.721382:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275968 00000100:00100000:1.0:1769074944.721385:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275968 00000100:00100000:1.0:1769074944.721432:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276480 00000100:00100000:1.0:1769074944.721435:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276480 00000100:00100000:1.0:1769074944.721457:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616275840 00000100:00100000:1.0:1769074944.721460:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616275840 00000100:00100000:1.0:1769074944.721480:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276352 00000100:00100000:1.0:1769074944.721483:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276352 00000100:00100000:1.0:1769074944.721500:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3176 00000100:00100000:1.0:1769074944.721506:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2418:x1855007616275968:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721559:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2418:x1855007616275968:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 52us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721566:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3176 00000100:00100000:1.0:1769074944.721580:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3177 00000100:00100000:1.0:1769074944.721585:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2418:x1855007616276480:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721611:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2418:x1855007616276480:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721617:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3177 00000100:00100000:1.0:1769074944.721628:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3178 00000100:00100000:1.0:1769074944.721633:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616275840:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721653:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616275840:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 20us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721659:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3178 00000100:00100000:1.0:1769074944.721669:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3179 00000100:00100000:1.0:1769074944.721675:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616276352:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721698:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2418:x1855007616276352:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721704:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3179 00000100:00100000:1.0:1769074944.721722:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276224 00000100:00100000:1.0:1769074944.721725:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276224 00000100:00100000:1.0:1769074944.721750:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276096 00000100:00100000:1.0:1769074944.721753:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276096 00000100:00100000:1.0:1769074944.721770:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2115 00000100:00100000:1.0:1769074944.721776:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616276224:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721801:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616276224:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721807:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2115 00000100:00100000:1.0:1769074944.721818:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2116 00000100:00100000:1.0:1769074944.721836:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b79a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2418:x1855007616276096:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074944.721861:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b79a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2418:x1855007616276096:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 38us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074944.721867:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2116 00000100:00080000:1.0:1769074944.722145:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1769074944.722150:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1769074944.722152:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769074944.722154:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074944.948156:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626655872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074944.948232:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074944.948387:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626655872 00000100:00100000:3.0:1769074944.948396:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626655872 00000100:00100000:3.0:1769074944.948461:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1769074944.948471:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626655872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769074944.948500:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2867200 granted 492255296 pending 229376 free 3764248576 avail 3532726272 00000100:00100000:3.0:1769074944.948630:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626655872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074944.948639:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00080000:1.0:1769074944.948697:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1769074944.948737:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626655872:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1769074945.203822:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1769074945.980622:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1769074945.980629:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1769074945.981372:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1769074945.981383:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1769074946.231731:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074946.251207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.251382:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276608 00000100:00100000:1.0:1769074946.251394:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276608 00002000:00100000:1.0:1769074946.251470:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x88:0x0] (0->157) req@ffff91617f8c8700 x1855007616276608/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.251481:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c8700 with x1855007616276608 ext(0->157) 00002000:00010000:1.0:1769074946.251487:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c8700 00000100:00100000:1.0:1769074946.251518:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 755 00000100:00100000:1.0:1769074946.251562:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2417:x1855007616276608:12345-192.168.204.32@tcp:4:cp.0 00000100:00080000:2.0:1769074946.252427:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074946.253317:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2417:x1855007616276608:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1785us (2127us total) trans 4294967906 rc 0/0 00000100:00100000:1.0:1769074946.253329:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 755 00002000:00100000:1.0:1769074946.253341:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x88:0x0] (0->157) req@ffff91617f8c8700 x1855007616276608/t4294967906(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.253349:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f8c8700 with x1855007616276608 ext(0->157) 00002000:00010000:1.0:1769074946.253354:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f8c8700 00000001:00080000:2.0:1769074946.258402:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967906 is committed 00000100:00100000:1.0:1769074946.263316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.263450:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276736 00000100:00100000:1.0:1769074946.263458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.263461:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276736 00000100:00100000:1.0:1769074946.263475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:3.0:1769074946.263521:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x88:0x0] (0->157) req@ffff916044d24000 x1855007616276736/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1769074946.263525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.263567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:3.0:1769074946.263567:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d24000 with x1855007616276736 ext(0->157) 00002000:00010000:3.0:1769074946.263573:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d24000 00000100:00100000:1.0:1769074946.263580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.263590:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276992 00000100:00100000:1.0:1769074946.263591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.263592:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276992 00000100:00100000:1.0:1769074946.263603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:3.0:1769074946.263608:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x89:0x0] (0->157) req@ffff916044d27480 x1855007616276992/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1769074946.263616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:3.0:1769074946.263616:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d27480 with x1855007616276992 ext(0->157) 00002000:00010000:3.0:1769074946.263620:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d27480 00000100:00100000:3.0:1769074946.263626:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616276864 00000100:00100000:3.0:1769074946.263629:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616276864 00002000:00100000:3.0:1769074946.263642:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x89:0x0] (0->157) req@ffff916044d27100 x1855007616276864/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263649:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d27100 with x1855007616276864 ext(0->157) 00000100:00100000:1.0:1769074946.263651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00010000:3.0:1769074946.263652:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d27100 00000100:00100000:3.0:1769074946.263658:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277248 00000100:00100000:3.0:1769074946.263661:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277248 00000100:00100000:1.0:1769074946.263668:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277504 00000100:00100000:1.0:1769074946.263671:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277504 00002000:00100000:3.0:1769074946.263672:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8a:0x0] (0->157) req@ffff916044d26d80 x1855007616277248/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263679:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26d80 with x1855007616277248 ext(0->157) 00002000:00010000:3.0:1769074946.263682:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d26d80 00002000:00100000:1.0:1769074946.263687:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x8b:0x0] (0->157) req@ffff916044d26a00 x1855007616277504/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1769074946.263688:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277760 00000100:00100000:3.0:1769074946.263690:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277760 00002000:00100000:1.0:1769074946.263696:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26a00 with x1855007616277504 ext(0->157) 00002000:00010000:1.0:1769074946.263699:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d26a00 00002000:00100000:3.0:1769074946.263700:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8c:0x0] (0->157) req@ffff916041e69c00 x1855007616277760/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1769074946.263706:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278016 00002000:00100000:3.0:1769074946.263707:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e69c00 with x1855007616277760 ext(0->157) 00002000:00010000:3.0:1769074946.263711:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e69c00 00000100:00100000:3.0:1769074946.263715:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278272 00000100:00100000:3.0:1769074946.263718:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278272 00000100:00100000:1.0:1769074946.263721:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278016 00002000:00100000:3.0:1769074946.263728:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8e:0x0] (0->157) req@ffff9160434af480 x1855007616278272/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.263732:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x8d:0x0] (0->157) req@ffff9160434aca80 x1855007616278016/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263736:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af480 with x1855007616278272 ext(0->157) 00002000:00100000:1.0:1769074946.263740:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434aca80 with x1855007616278016 ext(0->157) 00002000:00010000:3.0:1769074946.263740:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434af480 00002000:00010000:1.0:1769074946.263743:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434aca80 00000100:00100000:3.0:1769074946.263746:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278528 00000100:00100000:1.0:1769074946.263748:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277120 00000100:00100000:3.0:1769074946.263748:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278528 00000100:00100000:1.0:1769074946.263750:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277120 00002000:00100000:3.0:1769074946.263758:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x8f:0x0] (0->157) req@ffff9160434adc00 x1855007616278528/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.263760:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x8a:0x0] (0->157) req@ffff91604369d500 x1855007616277120/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263767:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434adc00 with x1855007616278528 ext(0->157) 00002000:00100000:1.0:1769074946.263768:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604369d500 with x1855007616277120 ext(0->157) 00002000:00010000:3.0:1769074946.263770:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434adc00 00002000:00010000:1.0:1769074946.263771:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604369d500 00000100:00100000:1.0:1769074946.263775:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277376 00000100:00100000:3.0:1769074946.263775:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277632 00000100:00100000:1.0:1769074946.263777:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277376 00000100:00100000:3.0:1769074946.263777:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277632 00002000:00100000:1.0:1769074946.263788:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x8b:0x0] (0->157) req@ffff91604369dc00 x1855007616277376/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263788:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x8c:0x0] (0->157) req@ffff91617ff78a80 x1855007616277632/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.263806:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604369dc00 with x1855007616277376 ext(0->157) 00002000:00100000:3.0:1769074946.263808:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617ff78a80 with x1855007616277632 ext(0->157) 00002000:00010000:1.0:1769074946.263810:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604369dc00 00002000:00010000:3.0:1769074946.263811:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617ff78a80 00000100:00100000:1.0:1769074946.263817:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278144 00000100:00100000:3.0:1769074946.263817:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616277888 00000100:00100000:1.0:1769074946.263819:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278144 00000100:00100000:3.0:1769074946.263819:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616277888 00002000:00100000:1.0:1769074946.263832:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x8e:0x0] (0->157) req@ffff91604b149180 x1855007616278144/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263832:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x8d:0x0] (0->157) req@ffff91617ff79180 x1855007616277888/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263841:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617ff79180 with x1855007616277888 ext(0->157) 00002000:00100000:1.0:1769074946.263842:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b149180 with x1855007616278144 ext(0->157) 00002000:00010000:3.0:1769074946.263844:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617ff79180 00002000:00010000:1.0:1769074946.263845:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b149180 00000100:00100000:1.0:1769074946.263850:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278656 00000100:00100000:3.0:1769074946.263850:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278400 00000100:00100000:1.0:1769074946.263852:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278656 00000100:00100000:3.0:1769074946.263852:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278400 00002000:00100000:1.0:1769074946.263863:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x90:0x0] (0->157) req@ffff91604f181880 x1855007616278656/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.263863:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x8f:0x0] (0->157) req@ffff91604f181f80 x1855007616278400/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.263870:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f181880 with x1855007616278656 ext(0->157) 00002000:00010000:1.0:1769074946.263873:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f181880 00002000:00100000:3.0:1769074946.263883:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f181f80 with x1855007616278400 ext(0->157) 00000100:00100000:1.0:1769074946.263884:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 756 00002000:00010000:3.0:1769074946.263886:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f181f80 00000100:00100000:1.0:1769074946.263893:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616276736:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074946.263894:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 757 00000100:00100000:3.0:1769074946.263899:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616276992:12345-192.168.204.32@tcp:4:cp.0 00000100:00080000:2.0:1769074946.263982:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1769074946.263998:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 758 00000100:00100000:2.0:1769074946.264007:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2418:x1855007616276864:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.264565:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 759 00000100:00100000:0.0:1769074946.264576:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616277248:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.267641:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 760 00000100:00100000:1.0:1769074946.267656:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2418:x1855007616277504:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.267978:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 761 00000100:00100000:1.0:1769074946.267987:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616277760:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.268148:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 762 00000100:00100000:1.0:1769074946.268171:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+231:2418:x1855007616278272:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.268350:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 763 00000100:00100000:1.0:1769074946.268357:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2418:x1855007616278016:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.268733:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2418:x1855007616277760:12345-192.168.204.32@tcp:4:cp.0 Request processed in 745us (5271us total) trans 4294967897 rc 0/0 00000100:00100000:1.0:1769074946.268743:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 761 00002000:00100000:1.0:1769074946.268751:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8c:0x0] (0->157) req@ffff916041e69c00 x1855007616277760/t4294967897(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.268761:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041e69c00 with x1855007616277760 ext(0->157) 00002000:00010000:1.0:1769074946.268782:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041e69c00 00000100:00100000:1.0:1769074946.268821:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 764 00000100:00100000:1.0:1769074946.268829:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2418:x1855007616278528:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074946.271793:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2418:x1855007616276992:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7880us (8420us total) trans 4294967902 rc 0/0 00000100:00100000:3.0:1769074946.271940:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 757 00002000:00100000:3.0:1769074946.271957:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x89:0x0] (0->157) req@ffff916044d27480 x1855007616276992/t4294967902(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.271966:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d27480 with x1855007616276992 ext(0->157) 00002000:00010000:3.0:1769074946.271972:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d27480 00000100:00100000:3.0:1769074946.272007:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 765 00000100:00100000:3.0:1769074946.272020:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2418:x1855007616277120:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.273522:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2418:x1855007616277248:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8938us (10099us total) trans 4294967901 rc 0/0 00000100:00100000:0.0:1769074946.273553:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 759 00002000:00100000:0.0:1769074946.273564:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8a:0x0] (0->157) req@ffff916044d26d80 x1855007616277248/t4294967901(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.273574:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26d80 with x1855007616277248 ext(0->157) 00002000:00010000:0.0:1769074946.273580:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d26d80 00000100:00100000:0.0:1769074946.273608:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 766 00000100:00100000:0.0:1769074946.273617:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2418:x1855007616277376:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074946.274252:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2418:x1855007616276864:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10245us (10860us total) trans 4294967907 rc 0/0 00000100:00100000:2.0:1769074946.274261:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 758 00002000:00100000:2.0:1769074946.274269:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x89:0x0] (0->157) req@ffff916044d27100 x1855007616276864/t4294967907(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074946.274506:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d27100 with x1855007616276864 ext(0->157) 00002000:00010000:2.0:1769074946.274511:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044d27100 00000100:00100000:2.0:1769074946.274555:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 767 00000100:00100000:2.0:1769074946.274564:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2418:x1855007616277632:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.275085:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616278528:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6255us (11574us total) trans 4294967900 rc 0/0 00000100:00100000:1.0:1769074946.275094:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 764 00002000:00100000:1.0:1769074946.275102:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x8f:0x0] (0->157) req@ffff9160434adc00 x1855007616278528/t4294967900(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.275111:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434adc00 with x1855007616278528 ext(0->157) 00002000:00010000:1.0:1769074946.275115:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434adc00 00000100:00100000:1.0:1769074946.275132:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 768 00000100:00100000:1.0:1769074946.275139:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2418:x1855007616277888:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.275375:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2418:x1855007616278016:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7017us (11897us total) trans 4294967899 rc 0/0 00000100:00100000:1.0:1769074946.275383:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 763 00002000:00100000:1.0:1769074946.275389:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x8d:0x0] (0->157) req@ffff9160434aca80 x1855007616278016/t4294967899(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.275398:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434aca80 with x1855007616278016 ext(0->157) 00002000:00010000:1.0:1769074946.275403:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434aca80 00000100:00100000:1.0:1769074946.275420:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 769 00000100:00100000:1.0:1769074946.275427:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2418:x1855007616278144:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.275629:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2418:x1855007616278272:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7459us (12134us total) trans 4294967898 rc 0/0 00000100:00100000:1.0:1769074946.275636:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 762 00002000:00100000:1.0:1769074946.275642:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x8e:0x0] (0->157) req@ffff9160434af480 x1855007616278272/t4294967898(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.275650:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434af480 with x1855007616278272 ext(0->157) 00002000:00010000:1.0:1769074946.275654:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434af480 00000100:00100000:1.0:1769074946.275669:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 770 00000100:00100000:1.0:1769074946.275677:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2418:x1855007616278656:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.275860:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2418:x1855007616277504:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8207us (12420us total) trans 4294967896 rc 0/0 00000100:00100000:1.0:1769074946.275868:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 760 00002000:00100000:1.0:1769074946.275874:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8b:0x0] (0->157) req@ffff916044d26a00 x1855007616277504/t4294967896(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.275882:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d26a00 with x1855007616277504 ext(0->157) 00002000:00010000:1.0:1769074946.275886:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d26a00 00000100:00100000:1.0:1769074946.275903:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 771 00000100:00100000:1.0:1769074946.275910:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616278400:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.276099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.276126:0:44302:0:(service.c:3434:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:1.0:1769074946.276133:0:44302:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_io00_010' 00000100:00100000:1.0:1769074946.276246:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.276435:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616277376:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2818us (12865us total) trans 4294967913 rc 0/0 00000100:00100000:0.0:1769074946.276448:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 766 00002000:00100000:0.0:1769074946.276454:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x8b:0x0] (0->157) req@ffff91604369dc00 x1855007616277376/t4294967913(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.276464:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604369dc00 with x1855007616277376 ext(0->157) 00002000:00010000:0.0:1769074946.276468:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604369dc00 00000100:00100000:0.0:1769074946.276482:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278784 00000100:00100000:0.0:1769074946.276489:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278784 00002000:00100000:0.0:1769074946.276515:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x90:0x0] (0->157) req@ffff916181773480 x1855007616278784/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.276524:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773480 with x1855007616278784 ext(0->157) 00002000:00010000:0.0:1769074946.276544:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773480 00000100:00100000:0.0:1769074946.276557:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616278912 00000100:00100000:0.0:1769074946.276560:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616278912 00002000:00100000:0.0:1769074946.276576:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x93:0x0] (0->157) req@ffff916181771f80 x1855007616278912/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.276583:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181771f80 with x1855007616278912 ext(0->157) 00002000:00010000:0.0:1769074946.276587:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916181771f80 00000100:00100000:0.0:1769074946.276595:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 772 00000100:00100000:0.0:1769074946.276602:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2418:x1855007616278784:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.277121:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2418:x1855007616276736:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13226us (13813us total) trans 4294967895 rc 0/0 00000100:00100000:0.0:1769074946.277140:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 756 00002000:00100000:0.0:1769074946.277147:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x88:0x0] (0->157) req@ffff916044d24000 x1855007616276736/t4294967895(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.277163:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044d24000 with x1855007616276736 ext(0->157) 00002000:00010000:0.0:1769074946.277167:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044d24000 00000100:00100000:0.0:1769074946.277185:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 773 00000100:00100000:0.0:1769074946.277191:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2417:x1855007616278912:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074946.277765:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616277120:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5746us (14234us total) trans 4294967914 rc 0/0 00000100:00100000:3.0:1769074946.277773:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 765 00002000:00100000:3.0:1769074946.277780:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x8a:0x0] (0->157) req@ffff91604369d500 x1855007616277120/t4294967914(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.277788:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604369d500 with x1855007616277120 ext(0->157) 00002000:00010000:3.0:1769074946.277792:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604369d500 00000100:00100000:0.0:1769074946.277807:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2417:x1855007616278912:12345-192.168.204.32@tcp:4:cp.0 Request processed in 604us (1550us total) trans 4294967915 rc 0/0 00000100:00100000:0.0:1769074946.277814:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 773 00002000:00100000:0.0:1769074946.277820:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x93:0x0] (0->157) req@ffff916181771f80 x1855007616278912/t4294967915(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.277829:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181771f80 with x1855007616278912 ext(0->157) 00002000:00010000:0.0:1769074946.277832:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916181771f80 00000100:00100000:1.0:1769074946.282051:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2418:x1855007616278656:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6365us (18390us total) trans 4294967911 rc 0/0 00000100:00100000:1.0:1769074946.282066:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 770 00002000:00100000:1.0:1769074946.282080:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x90:0x0] (0->157) req@ffff91604f181880 x1855007616278656/t4294967911(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.282088:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f181880 with x1855007616278656 ext(0->157) 00002000:00010000:1.0:1769074946.282095:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f181880 00000100:00100000:1.0:1769074946.282140:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604f181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2418:x1855007616278400:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6230us (18521us total) trans 4294967912 rc 0/0 00000100:00100000:1.0:1769074946.282147:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 771 00000100:00100000:0.0:1769074946.282394:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2418:x1855007616277888:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7254us (18800us total) trans 4294967909 rc 0/0 00000100:00100000:0.0:1769074946.282402:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 768 00002000:00100000:0.0:1769074946.282408:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x8d:0x0] (0->157) req@ffff91617ff79180 x1855007616277888/t4294967909(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.282417:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617ff79180 with x1855007616277888 ext(0->157) 00002000:00010000:0.0:1769074946.282422:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617ff79180 00002000:00100000:1.0:1769074946.283998:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x8f:0x0] (0->157) req@ffff91604f181f80 x1855007616278400/t4294967912(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.284014:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604f181f80 with x1855007616278400 ext(0->157) 00002000:00010000:1.0:1769074946.284021:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604f181f80 00000100:00100000:1.0:1769074946.284112:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2418:x1855007616278784:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7509us (8013us total) trans 4294967903 rc 0/0 00000100:00100000:1.0:1769074946.284122:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 772 00002000:00100000:1.0:1769074946.284129:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x90:0x0] (0->157) req@ffff916181773480 x1855007616278784/t4294967903(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.284137:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916181773480 with x1855007616278784 ext(0->157) 00002000:00010000:1.0:1769074946.284141:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916181773480 00000100:00100000:3.0:1769074946.284925:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2418:x1855007616278144:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9494us (21316us total) trans 4294967910 rc 0/0 00000100:00100000:3.0:1769074946.284938:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 769 00002000:00100000:3.0:1769074946.284947:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x8e:0x0] (0->157) req@ffff91604b149180 x1855007616278144/t4294967910(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.284955:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b149180 with x1855007616278144 ext(0->157) 00002000:00010000:3.0:1769074946.284960:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b149180 00000100:00100000:3.0:1769074946.285417:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2418:x1855007616277632:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10853us (21834us total) trans 4294967908 rc 0/0 00000100:00100000:3.0:1769074946.285426:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 767 00002000:00100000:3.0:1769074946.285433:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x8c:0x0] (0->157) req@ffff91617ff78a80 x1855007616277632/t4294967908(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.285441:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617ff78a80 with x1855007616277632 ext(0->157) 00002000:00010000:3.0:1769074946.285445:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617ff78a80 00000001:00080000:1.0:1769074946.297919:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967902 is committed 00000100:00100000:1.0:1769074946.301935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.301986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.302162:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279168 00000100:00100000:3.0:1769074946.302175:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279168 00002000:00100000:3.0:1769074946.302243:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x93:0x0] (0->157) req@ffff916043581500 x1855007616279168/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.302255:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581500 with x1855007616279168 ext(0->157) 00002000:00010000:3.0:1769074946.302261:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581500 00000100:00100000:3.0:1769074946.302289:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279040 00000100:00100000:3.0:1769074946.302293:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279040 00002000:00100000:3.0:1769074946.302307:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x95:0x0] (0->157) req@ffff916043581c00 x1855007616279040/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.302316:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581c00 with x1855007616279040 ext(0->157) 00002000:00010000:3.0:1769074946.302320:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581c00 00000100:00100000:3.0:1769074946.302347:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 774 00000100:00100000:3.0:1769074946.302356:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+209:2417:x1855007616279168:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.303042:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 775 00000100:00100000:0.0:1769074946.303055:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+211:2417:x1855007616279040:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.304766:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2417:x1855007616279040:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1704us (2770us total) trans 4294967905 rc 0/0 00000100:00100000:0.0:1769074946.304790:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 775 00002000:00100000:0.0:1769074946.304813:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x95:0x0] (0->157) req@ffff916043581c00 x1855007616279040/t4294967905(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.304823:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581c00 with x1855007616279040 ext(0->157) 00002000:00010000:0.0:1769074946.304829:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581c00 00000100:00100000:3.0:1769074946.304976:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2417:x1855007616279168:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2620us (3053us total) trans 4294967904 rc 0/0 00000100:00100000:3.0:1769074946.304984:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 774 00002000:00100000:3.0:1769074946.304990:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x93:0x0] (0->157) req@ffff916043581500 x1855007616279168/t4294967904(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.304998:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916043581500 with x1855007616279168 ext(0->157) 00002000:00010000:3.0:1769074946.305001:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916043581500 00000100:00100000:2.0:1769074946.314487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074946.314617:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279296 00000100:00100000:3.0:1769074946.314636:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279296 00000100:00100000:2.0:1769074946.314671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:3.0:1769074946.314709:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x96:0x0] (0->157) req@ffff916052a42300 x1855007616279296/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.314724:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a42300 with x1855007616279296 ext(0->157) 00002000:00010000:3.0:1769074946.314731:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916052a42300 00000100:00100000:0.0:1769074946.316355:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279552 00000100:00100000:0.0:1769074946.316369:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279552 00002000:00100000:0.0:1769074946.316520:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x97:0x0] (0->157) req@ffff916052a40e00 x1855007616279552/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.316549:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a40e00 with x1855007616279552 ext(0->157) 00002000:00010000:0.0:1769074946.316557:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916052a40e00 00000100:00100000:0.0:1769074946.316663:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 776 00000100:00100000:0.0:1769074946.316674:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2418:x1855007616279296:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.317167:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.317211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.317237:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279808 00000100:00100000:0.0:1769074946.317242:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279808 00002000:00100000:0.0:1769074946.317263:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x98:0x0] (0->157) req@ffff91617fb15880 x1855007616279808/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.317271:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb15880 with x1855007616279808 ext(0->157) 00002000:00010000:0.0:1769074946.317275:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb15880 00000100:00100000:0.0:1769074946.317290:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280064 00000100:00100000:0.0:1769074946.317293:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280064 00002000:00100000:0.0:1769074946.317307:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x92:0x0] (0->157) req@ffff91617fb17100 x1855007616280064/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.317321:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb17100 with x1855007616280064 ext(0->157) 00002000:00010000:0.0:1769074946.317325:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fb17100 00000100:00100000:0.0:1769074946.317340:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 777 00000100:00100000:0.0:1769074946.317347:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2418:x1855007616279552:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.317564:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 778 00000100:00100000:0.0:1769074946.317572:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+218:2418:x1855007616279808:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.317730:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 779 00000100:00100000:0.0:1769074946.317738:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2418:x1855007616280064:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.317967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.317989:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279424 00000100:00100000:0.0:1769074946.317994:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279424 00002000:00100000:0.0:1769074946.318013:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x92:0x0] (0->157) req@ffff91617fb14a80 x1855007616279424/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.318021:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb14a80 with x1855007616279424 ext(0->157) 00002000:00010000:0.0:1769074946.318025:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb14a80 00000100:00100000:0.0:1769074946.318044:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 780 00000100:00100000:0.0:1769074946.318050:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616279424:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.318224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.318240:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279680 00000100:00100000:0.0:1769074946.318245:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279680 00002000:00100000:0.0:1769074946.318262:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x94:0x0] (0->157) req@ffff91617fb15f80 x1855007616279680/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.318277:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb15f80 with x1855007616279680 ext(0->157) 00002000:00010000:0.0:1769074946.318281:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb15f80 00000100:00100000:0.0:1769074946.318298:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 781 00000100:00100000:0.0:1769074946.318305:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2418:x1855007616279680:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.318465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.318480:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616279936 00000100:00100000:0.0:1769074946.318484:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616279936 00002000:00100000:0.0:1769074946.318501:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x91:0x0] (0->157) req@ffff916045a6b800 x1855007616279936/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.318509:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b800 with x1855007616279936 ext(0->157) 00002000:00010000:0.0:1769074946.318513:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a6b800 00000100:00100000:0.0:1769074946.318562:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 782 00000100:00100000:0.0:1769074946.318570:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2418:x1855007616279936:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.318748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.318765:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280192 00000100:00100000:0.0:1769074946.318769:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280192 00002000:00100000:0.0:1769074946.318788:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x97:0x0] (0->157) req@ffff916045a6a300 x1855007616280192/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.318811:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6a300 with x1855007616280192 ext(0->157) 00002000:00010000:0.0:1769074946.318816:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6a300 00000100:00100000:0.0:1769074946.318829:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 783 00000100:00100000:0.0:1769074946.318836:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2418:x1855007616280192:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.319050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.319067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.319081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.319095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.319109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074946.319130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074946.320107:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280448 00000100:00100000:1.0:1769074946.320118:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280448 00002000:00100000:1.0:1769074946.320158:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x98:0x0] (0->157) req@ffff916045a68000 x1855007616280448/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320169:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68000 with x1855007616280448 ext(0->157) 00002000:00010000:1.0:1769074946.320174:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68000 00000100:00100000:1.0:1769074946.320187:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280704 00000100:00100000:1.0:1769074946.320199:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280704 00002000:00100000:1.0:1769074946.320214:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x99:0x0] (0->157) req@ffff916045a69180 x1855007616280704/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320223:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69180 with x1855007616280704 ext(0->157) 00002000:00010000:1.0:1769074946.320227:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69180 00000100:00100000:1.0:1769074946.320233:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280960 00000100:00100000:1.0:1769074946.320235:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280960 00002000:00100000:1.0:1769074946.320244:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x96:0x0] (0->157) req@ffff916045a68380 x1855007616280960/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320252:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68380 with x1855007616280960 ext(0->157) 00002000:00010000:1.0:1769074946.320255:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68380 00000100:00100000:1.0:1769074946.320261:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280320 00000100:00100000:1.0:1769074946.320264:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280320 00002000:00100000:1.0:1769074946.320274:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x94:0x0] (0->157) req@ffff916045a68e00 x1855007616280320/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320281:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68e00 with x1855007616280320 ext(0->157) 00002000:00010000:1.0:1769074946.320284:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68e00 00000100:00100000:1.0:1769074946.320289:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280576 00000100:00100000:1.0:1769074946.320291:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280576 00002000:00100000:1.0:1769074946.320303:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x91:0x0] (0->157) req@ffff916045a69f80 x1855007616280576/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320310:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69f80 with x1855007616280576 ext(0->157) 00002000:00010000:1.0:1769074946.320313:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69f80 00000100:00100000:1.0:1769074946.320319:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616280832 00000100:00100000:1.0:1769074946.320321:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616280832 00002000:00100000:1.0:1769074946.320334:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x95:0x0] (0->157) req@ffff916045a6ad80 x1855007616280832/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/0 e 0 to 0 dl 1769074957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.320341:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6ad80 with x1855007616280832 ext(0->157) 00002000:00010000:1.0:1769074946.320345:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6ad80 00000100:00100000:1.0:1769074946.320355:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 784 00000100:00100000:1.0:1769074946.320363:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2417:x1855007616280448:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.321938:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2417:x1855007616280448:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1568us (2882us total) trans 4294967918 rc 0/0 00000100:00100000:1.0:1769074946.321951:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 784 00002000:00100000:1.0:1769074946.321969:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x98:0x0] (0->157) req@ffff916045a68000 x1855007616280448/t4294967918(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.321978:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68000 with x1855007616280448 ext(0->157) 00002000:00010000:1.0:1769074946.321983:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68000 00000100:00100000:1.0:1769074946.322012:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 785 00000100:00100000:1.0:1769074946.322022:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2417:x1855007616280704:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.324623:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2417:x1855007616280704:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2594us (5545us total) trans 4294967919 rc 0/0 00000100:00100000:1.0:1769074946.324637:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 785 00002000:00100000:1.0:1769074946.324651:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x99:0x0] (0->157) req@ffff916045a69180 x1855007616280704/t4294967919(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.324662:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69180 with x1855007616280704 ext(0->157) 00002000:00010000:1.0:1769074946.324668:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69180 00000100:00100000:1.0:1769074946.324701:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 786 00000100:00100000:1.0:1769074946.324713:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2417:x1855007616280960:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074946.325925:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2418:x1855007616280064:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8181us (8706us total) trans 4294967916 rc 0/0 00000100:00100000:1.0:1769074946.325937:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 779 00002000:00100000:1.0:1769074946.325946:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x92:0x0] (0->157) req@ffff91617fb17100 x1855007616280064/t4294967916(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.325956:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb17100 with x1855007616280064 ext(0->157) 00002000:00010000:1.0:1769074946.325961:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617fb17100 00000100:00100000:1.0:1769074946.325986:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 787 00000100:00100000:1.0:1769074946.325996:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2417:x1855007616280320:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.326517:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616279808:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8944us (9349us total) trans 4294967908 rc 0/0 00000100:00100000:0.0:1769074946.326525:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 778 00002000:00100000:0.0:1769074946.326556:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x98:0x0] (0->157) req@ffff91617fb15880 x1855007616279808/t4294967908(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.326565:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb15880 with x1855007616279808 ext(0->157) 00002000:00010000:0.0:1769074946.326570:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb15880 00000100:00100000:0.0:1769074946.326588:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 788 00000100:00100000:0.0:1769074946.326595:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2417:x1855007616280576:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.326817:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2418:x1855007616279424:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8766us (8850us total) trans 4294967909 rc 0/0 00000100:00100000:0.0:1769074946.326824:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 780 00002000:00100000:0.0:1769074946.326830:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x92:0x0] (0->157) req@ffff91617fb14a80 x1855007616279424/t4294967909(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.326838:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb14a80 with x1855007616279424 ext(0->157) 00002000:00010000:0.0:1769074946.326842:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb14a80 00000100:00100000:0.0:1769074946.326859:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 789 00000100:00100000:0.0:1769074946.326865:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2417:x1855007616280832:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074946.327654:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2418:x1855007616279936:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9081us (9185us total) trans 4294967911 rc 0/0 00000100:00100000:0.0:1769074946.327664:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 782 00002000:00100000:0.0:1769074946.327671:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x91:0x0] (0->157) req@ffff916045a6b800 x1855007616279936/t4294967911(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.327680:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b800 with x1855007616279936 ext(0->157) 00002000:00010000:0.0:1769074946.327684:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a6b800 00000100:00100000:0.0:1769074946.327728:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2417:x1855007616280576:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1133us (8618us total) trans 4294967921 rc 0/0 00000100:00100000:0.0:1769074946.327735:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 788 00002000:00100000:0.0:1769074946.327741:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x91:0x0] (0->157) req@ffff916045a69f80 x1855007616280576/t4294967921(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.327749:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69f80 with x1855007616280576 ext(0->157) 00002000:00010000:0.0:1769074946.327752:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69f80 00000100:00100000:0.0:1769074946.327787:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2417:x1855007616280832:12345-192.168.204.32@tcp:4:cp.0 Request processed in 922us (8656us total) trans 4294967922 rc 0/0 00000100:00100000:0.0:1769074946.327806:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 789 00002000:00100000:0.0:1769074946.327811:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x95:0x0] (0->157) req@ffff916045a6ad80 x1855007616280832/t4294967922(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.327819:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6ad80 with x1855007616280832 ext(0->157) 00002000:00010000:0.0:1769074946.327823:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6ad80 00000100:00100000:0.0:1769074946.327949:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617fb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2418:x1855007616279680:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9644us (9725us total) trans 4294967910 rc 0/0 00000100:00100000:0.0:1769074946.327956:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 781 00002000:00100000:0.0:1769074946.327962:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x94:0x0] (0->157) req@ffff91617fb15f80 x1855007616279680/t4294967910(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.327971:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617fb15f80 with x1855007616279680 ext(0->157) 00002000:00010000:0.0:1769074946.327975:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617fb15f80 00000100:00100000:0.0:1769074946.328018:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2418:x1855007616279296:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11346us (13541us total) trans 4294967906 rc 0/0 00000100:00100000:0.0:1769074946.328025:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 776 00002000:00100000:0.0:1769074946.328030:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x96:0x0] (0->157) req@ffff916052a42300 x1855007616279296/t4294967906(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074946.328037:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a42300 with x1855007616279296 ext(0->157) 00002000:00010000:0.0:1769074946.328040:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916052a42300 00000100:00100000:3.0:1769074946.328682:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2418:x1855007616280192:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9844us (9933us total) trans 4294967917 rc 0/0 00000100:00100000:3.0:1769074946.328691:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 783 00002000:00100000:3.0:1769074946.328698:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x97:0x0] (0->157) req@ffff916045a6a300 x1855007616280192/t4294967917(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.328706:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6a300 with x1855007616280192 ext(0->157) 00002000:00010000:3.0:1769074946.328710:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6a300 00000100:00100000:1.0:1769074946.329859:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2418:x1855007616279552:12345-192.168.204.32@tcp:4:cp.0 Request processed in 12505us (15321us total) trans 4294967907 rc 0/0 00000100:00100000:1.0:1769074946.329876:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 777 00002000:00100000:1.0:1769074946.329885:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x97:0x0] (0->157) req@ffff916052a40e00 x1855007616279552/t4294967907(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074946.329895:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a40e00 with x1855007616279552 ext(0->157) 00002000:00010000:1.0:1769074946.329900:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916052a40e00 00000100:00100000:3.0:1769074946.331271:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2417:x1855007616280320:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5271us (12167us total) trans 4294967920 rc 0/0 00000100:00100000:3.0:1769074946.331287:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 787 00002000:00100000:3.0:1769074946.331298:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x94:0x0] (0->157) req@ffff916045a68e00 x1855007616280320/t4294967920(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074946.331307:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68e00 with x1855007616280320 ext(0->157) 00002000:00010000:3.0:1769074946.331312:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68e00 00000100:00100000:2.0:1769074946.336638:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2417:x1855007616280960:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11915us (17542us total) trans 4294967923 rc 0/0 00000100:00100000:2.0:1769074946.336653:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 786 00002000:00100000:2.0:1769074946.336667:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x96:0x0] (0->157) req@ffff916045a68380 x1855007616280960/t4294967923(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:482/0 lens 648/448 e 0 to 0 dl 1769074957 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074946.336678:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68380 with x1855007616280960 ext(0->157) 00002000:00010000:2.0:1769074946.336683:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68380 00000100:00100000:1.0:1769074946.484710:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626656000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769074946.484778:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.484876:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626656512:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.484902:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.484924:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626657024:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.484944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.484960:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626657536:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.484981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.485004:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1769074946.485010:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626656128:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485036:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.485057:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626656640:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.485091:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626657152:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.485125:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1855007626657664:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485144:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.485177:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656512 00000100:00100000:1.0:1769074946.485183:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656512 00000100:00100000:1.0:1769074946.485247:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657024 00000100:00100000:1.0:1769074946.485250:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657024 00000100:00100000:1.0:1769074946.485267:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656640 00000100:00100000:1.0:1769074946.485269:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656640 00000100:00100000:1.0:1769074946.485285:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657664 00000100:00100000:1.0:1769074946.485288:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657664 00000100:00100000:1.0:1769074946.485301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:1.0:1769074946.485309:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626656512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485358:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1855007626656512:12345-0@lo:400:kworker.0 Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485366:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:1.0:1769074946.485381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:1.0:1769074946.485387:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626657024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485413:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1855007626657024:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485419:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:1.0:1769074946.485430:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:1.0:1769074946.485437:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626656640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485461:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626656640:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485466:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:1.0:1769074946.485477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1769074946.485483:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1855007626657664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485507:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1855007626657664:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485513:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1769074946.485558:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657536 00000100:00100000:1.0:1769074946.485562:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657536 00000100:00100000:1.0:1769074946.485589:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657152 00000100:00100000:1.0:1769074946.485592:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657152 00000100:00100000:1.0:1769074946.485612:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1769074946.485617:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626657536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485646:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626657536:12345-0@lo:400:kworker.0 Request processed in 29us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485652:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1769074946.485663:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1769074946.485669:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626657152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485692:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626657152:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485697:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1769074946.485716:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656128 00000100:00100000:1.0:1769074946.485719:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656128 00000100:00100000:1.0:1769074946.485740:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1769074946.485746:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626656128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485773:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626656128:12345-0@lo:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.485778:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1769074946.485827:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1769074946.485832:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1769074946.485834:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769074946.485883:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626656128:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485898:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626656640:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485906:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626657152:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485914:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1855007626657664:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485922:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1855007626656512:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485932:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1855007626657024:0@lo:400:kworker.0 00000100:00100000:1.0:1769074946.485941:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626657536:0@lo:400:kworker.0 00000100:00100000:3.0:1769074946.486342:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656000 00000100:00100000:3.0:1769074946.486347:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656000 00000100:00100000:3.0:1769074946.486401:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1769074946.486409:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626656000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1769074946.486424:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2322432 granted 491731008 pending 258048 free 3915456512 avail 3683532800 00000100:00100000:3.0:1769074946.486467:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1855007626656000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074946.486474:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1769074946.486639:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626656256:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486716:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626656768:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486740:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486764:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657280:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486782:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486808:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626657792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074946.486825:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486837:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1769074946.486844:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626656384:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486862:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486874:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626656896:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486892:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486906:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657408:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.486924:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486937:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916052a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074946.486951:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074946.486972:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656256 00000100:00100000:0.0:1769074946.486976:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656256 00000100:00100000:0.0:1769074946.486996:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657280 00000100:00100000:0.0:1769074946.486999:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657280 00000100:00100000:0.0:1769074946.487008:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657792 00000100:00100000:0.0:1769074946.487010:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657792 00000100:00100000:0.0:1769074946.487018:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657920 00000100:00100000:0.0:1769074946.487020:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657920 00000100:00100000:0.0:1769074946.487030:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1769074946.487036:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3656:x1855007626656256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487071:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3656:x1855007626656256:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487076:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1769074946.487089:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1769074946.487094:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1855007626657280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487116:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1855007626657280:12345-0@lo:400:kworker.0 Request processed in 21us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487122:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1769074946.487132:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1769074946.487136:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626657792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1769074946.487156:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:0.0:1769074946.487181:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626657792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487198:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1769074946.487210:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1769074946.487216:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626657920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1769074946.487230:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:0.0:1769074946.487253:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626657920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487259:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1769074946.487277:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656768 00000100:00100000:0.0:1769074946.487280:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656768 00000100:00100000:0.0:1769074946.487299:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626657408 00000100:00100000:0.0:1769074946.487301:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626657408 00000100:00100000:0.0:1769074946.487317:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1769074946.487322:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626656768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487346:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626656768:12345-0@lo:400:kworker.0 Request processed in 24us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487352:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1769074946.487361:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1769074946.487367:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626657408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487388:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626657408:12345-0@lo:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487393:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1769074946.487412:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656384 00000100:00100000:0.0:1769074946.487414:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656384 00000100:00100000:0.0:1769074946.487434:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626656896 00000100:00100000:0.0:1769074946.487436:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626656896 00000100:00100000:0.0:1769074946.487453:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:0.0:1769074946.487458:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626656384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487482:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626656384:12345-0@lo:400:kworker.0 Request processed in 24us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487488:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:0.0:1769074946.487498:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1769074946.487503:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487522:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626656896:12345-0@lo:400:kworker.0 Request processed in 20us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074946.487528:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1769074946.487591:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626656384:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487600:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626656896:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487607:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657408:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487618:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916052a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1769074946.487625:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626656256:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487632:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626656768:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487638:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626657280:0@lo:400:kworker.0 00000100:00100000:0.0:1769074946.487646:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626657792:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1769074946.489156:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769074946.489169:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074946.489879:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626656000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074946.997374:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1769074946.997449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.997503:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658176 00000100:00100000:1.0:1769074946.997512:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658176 00000100:00100000:3.0:1769074946.997528:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1769074946.997549:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1769074946.997573:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074946.997581:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658048 00000100:00100000:1.0:1769074946.997585:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658048 00000100:00100000:1.0:1769074946.997601:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1769074946.997606:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1769074946.997609:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626658176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1769074946.997612:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626658048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1769074946.997629:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2322432 granted 491731008 pending 258048 free 3915456512 avail 3683532800 00002000:00000024:1.0:1769074946.997634:0:8407:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2322432 granted 491997248 pending 487424 free 3764174848 avail 3532652544 00000100:00100000:1.0:1769074946.997668:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626658176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074946.997675:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1769074947.005554:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626658048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7912us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074947.005570:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1769074947.005728:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769074947.005748:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626658176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1769074947.251714:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1769074948.276009:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769074949.299911:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074949.838600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074949.838643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074949.838749:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281088 00000100:00100000:1.0:1769074949.838759:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281088 00000100:00100000:1.0:1769074949.838822:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 283 00000100:00100000:1.0:1769074949.838832:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616281088:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074949.838911:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616281088:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074949.838919:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 283 00000100:00100000:2.0:1769074949.839006:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281216 00000100:00100000:2.0:1769074949.839011:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281216 00000100:00100000:2.0:1769074949.839067:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3186 00000100:00100000:2.0:1769074949.839075:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616281216:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074949.839106:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616281216:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074949.839112:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3186 00000100:00080000:1.0:1769074949.839163:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074949.846798:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074949.846850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074949.846882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074949.846915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074949.846942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074949.846978:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281728 00000100:00100000:3.0:1769074949.846990:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281728 00000100:00100000:3.0:1769074949.847065:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281344 00000100:00100000:3.0:1769074949.847068:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281344 00000100:00100000:3.0:1769074949.847083:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281856 00000100:00100000:3.0:1769074949.847085:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281856 00000100:00100000:3.0:1769074949.847102:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3187 00000100:00100000:3.0:1769074949.847113:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616281728:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074949.847263:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3188 00000100:00100000:2.0:1769074949.847273:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2417:x1855007616281344:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074949.847351:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2417:x1855007616281344:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 80us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074949.847360:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3188 00000100:00100000:2.0:1769074949.847382:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3189 00000100:00100000:2.0:1769074949.847389:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2417:x1855007616281856:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074949.847434:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2417:x1855007616281856:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 46us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074949.847441:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3189 00000100:00080000:2.0:1769074949.847482:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1769074949.847487:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1769074949.848115:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616281728:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 1002us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074949.848248:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3187 00000100:00100000:1.0:1769074949.848893:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281472 00000100:00100000:1.0:1769074949.848902:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281472 00000100:00100000:1.0:1769074949.848963:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281600 00000100:00100000:1.0:1769074949.848966:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281600 00000100:00100000:1.0:1769074949.848988:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2121 00000100:00100000:1.0:1769074949.848996:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616281472:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074949.849044:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616281472:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 50us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074949.849051:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2121 00000100:00100000:1.0:1769074949.849066:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2122 00000100:00100000:1.0:1769074949.849073:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2417:x1855007616281600:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074949.849094:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2417:x1855007616281600:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 23us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074949.849099:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2122 00000100:00080000:2.0:1769074949.849588:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1769074949.849593:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074950.068361:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1769074950.068385:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626658304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074950.068467:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074950.068780:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658304 00000100:00100000:3.0:1769074950.068790:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658304 00000100:00100000:3.0:1769074950.068848:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1769074950.068859:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626658304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1769074950.068888:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 2322432 granted 491997248 pending 487424 free 3764174848 avail 3532652544 00000100:00100000:3.0:1769074950.068931:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626658304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074950.068939:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00080000:2.0:1769074950.069011:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1769074950.069096:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617b57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626658304:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1769074950.324673:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769074951.347708:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074951.376943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.376989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074951.377106:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616281984 00000100:00100000:0.0:1769074951.377118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074951.377118:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616281984 00000100:00100000:0.0:1769074951.377134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.377189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00002000:00100000:1.0:1769074951.377190:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x99:0x0] (0->157) req@ffff916049d20a80 x1855007616281984/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.377202:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20a80 with x1855007616281984 ext(0->157) 00002000:00010000:1.0:1769074951.377207:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20a80 00000100:00100000:0.0:1769074951.377215:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282240 00000100:00100000:0.0:1769074951.377218:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282240 00000100:00100000:1.0:1769074951.377221:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282496 00000100:00100000:1.0:1769074951.377223:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282496 00002000:00100000:1.0:1769074951.377235:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9b:0x0] (0->157) req@ffff916049d21f80 x1855007616282496/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.377237:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9a:0x0] (0->157) req@ffff916049d20380 x1855007616282240/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.377244:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d21f80 with x1855007616282496 ext(0->157) 00002000:00100000:0.0:1769074951.377246:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20380 with x1855007616282240 ext(0->157) 00002000:00010000:1.0:1769074951.377248:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d21f80 00002000:00010000:0.0:1769074951.377250:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20380 00000100:00100000:1.0:1769074951.377254:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282752 00000100:00100000:0.0:1769074951.377255:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283008 00000100:00100000:0.0:1769074951.377257:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283008 00000100:00100000:1.0:1769074951.377257:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282752 00002000:00100000:0.0:1769074951.377267:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9d:0x0] (0->157) req@ffff916049d22680 x1855007616283008/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.377267:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9c:0x0] (0->157) req@ffff916049d20e00 x1855007616282752/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.377276:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d22680 with x1855007616283008 ext(0->157) 00002000:00100000:1.0:1769074951.377276:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20e00 with x1855007616282752 ext(0->157) 00002000:00010000:0.0:1769074951.377279:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d22680 00002000:00010000:1.0:1769074951.377279:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20e00 00000100:00100000:1.0:1769074951.377284:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283264 00000100:00100000:0.0:1769074951.377285:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283520 00000100:00100000:0.0:1769074951.377287:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283520 00000100:00100000:1.0:1769074951.377287:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283264 00002000:00100000:0.0:1769074951.377297:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9f:0x0] (0->157) req@ffff916049d23800 x1855007616283520/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.377297:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9e:0x0] (0->157) req@ffff916049d23480 x1855007616283264/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.377305:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d23800 with x1855007616283520 ext(0->157) 00002000:00100000:1.0:1769074951.377305:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d23480 with x1855007616283264 ext(0->157) 00002000:00010000:0.0:1769074951.377309:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d23800 00002000:00010000:1.0:1769074951.377309:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d23480 00000100:00100000:0.0:1769074951.377315:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284032 00000100:00100000:1.0:1769074951.377315:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283776 00000100:00100000:0.0:1769074951.377317:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284032 00000100:00100000:1.0:1769074951.377317:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283776 00002000:00100000:0.0:1769074951.377327:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa1:0x0] (0->157) req@ffff9161815fed80 x1855007616284032/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.377334:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fed80 with x1855007616284032 ext(0->157) 00002000:00100000:1.0:1769074951.377337:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa0:0x0] (0->157) req@ffff9161815fd180 x1855007616283776/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1769074951.377338:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815fed80 00000100:00100000:0.0:1769074951.377343:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282112 00000100:00100000:0.0:1769074951.377345:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282112 00002000:00100000:1.0:1769074951.377345:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd180 with x1855007616283776 ext(0->157) 00002000:00010000:1.0:1769074951.377347:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815fd180 00000100:00100000:1.0:1769074951.377352:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282368 00000100:00100000:1.0:1769074951.377355:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282368 00002000:00100000:0.0:1769074951.377360:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x9a:0x0] (0->157) req@ffff9161815fc700 x1855007616282112/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.377363:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x9b:0x0] (0->157) req@ffff9161815fe680 x1855007616282368/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.377368:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fc700 with x1855007616282112 ext(0->157) 00002000:00010000:0.0:1769074951.377372:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fc700 00002000:00100000:1.0:1769074951.377372:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fe680 with x1855007616282368 ext(0->157) 00002000:00010000:1.0:1769074951.377375:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fe680 00000100:00100000:1.0:1769074951.377382:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 790 00000100:00100000:1.0:1769074951.377389:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2419:x1855007616281984:12345-192.168.204.32@tcp:4:cp.0 00000100:00080000:2.0:1769074951.377448:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1769074951.377452:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1769074951.387896:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 791 00000100:00100000:0.0:1769074951.387926:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2419:x1855007616282496:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.388393:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 792 00000100:00100000:0.0:1769074951.388403:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2419:x1855007616282240:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.388706:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284288 00000100:00100000:0.0:1769074951.388726:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284288 00000100:00100000:0.0:1769074951.388772:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2903 00000100:00100000:0.0:1769074951.388779:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616284288:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:0.0:1769074951.388871:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616284288:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 91us (11716us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.388878:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2903 00000100:00100000:2.0:1769074951.389869:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 793 00000100:00100000:2.0:1769074951.389888:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2419:x1855007616282752:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.390592:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2419:x1855007616282752:12345-192.168.204.32@tcp:4:cp.0 Request processed in 710us (13546us total) trans 4294967915 rc 0/0 00000100:00100000:2.0:1769074951.390604:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 793 00002000:00100000:2.0:1769074951.390615:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x9c:0x0] (0->157) req@ffff916049d20e00 x1855007616282752/t4294967915(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.390625:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20e00 with x1855007616282752 ext(0->157) 00002000:00010000:2.0:1769074951.390631:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20e00 00000100:00100000:2.0:1769074951.390658:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 794 00000100:00100000:2.0:1769074951.390667:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2419:x1855007616283008:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.391098:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 795 00000100:00100000:2.0:1769074951.391188:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 796 00000100:00100000:2.0:1769074951.391196:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616283264:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.391384:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 797 00000100:00100000:2.0:1769074951.391392:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2419:x1855007616284032:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.391617:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 798 00000100:00100000:2.0:1769074951.391625:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2419:x1855007616283776:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.391800:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 799 00000100:00100000:2.0:1769074951.391808:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2419:x1855007616282112:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.392167:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2419:x1855007616283520:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.392483:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+249:2419:x1855007616281984:12345-192.168.204.32@tcp:4:cp.0 Request processed in 15092us (15549us total) trans 4294967912 rc 0/0 00000100:00100000:2.0:1769074951.392492:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 790 00002000:00100000:2.0:1769074951.392502:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x99:0x0] (0->157) req@ffff916049d20a80 x1855007616281984/t4294967912(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.392512:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20a80 with x1855007616281984 ext(0->157) 00002000:00010000:2.0:1769074951.392518:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20a80 00000100:00100000:2.0:1769074951.392566:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 800 00000100:00100000:2.0:1769074951.392574:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2419:x1855007616282368:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.392696:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2419:x1855007616282496:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4785us (15680us total) trans 4294967913 rc 0/0 00000100:00100000:2.0:1769074951.392704:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 791 00002000:00100000:2.0:1769074951.392722:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x9b:0x0] (0->157) req@ffff916049d21f80 x1855007616282496/t4294967913(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.392736:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d21f80 with x1855007616282496 ext(0->157) 00002000:00010000:2.0:1769074951.392741:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d21f80 00000100:00100000:2.0:1769074951.392791:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2419:x1855007616282240:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4390us (15801us total) trans 4294967914 rc 0/0 00000100:00100000:2.0:1769074951.392798:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 792 00002000:00100000:2.0:1769074951.392804:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x9a:0x0] (0->157) req@ffff916049d20380 x1855007616282240/t4294967914(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.392812:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d20380 with x1855007616282240 ext(0->157) 00002000:00010000:2.0:1769074951.392816:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d20380 00000100:00100000:2.0:1769074951.396075:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2419:x1855007616283264:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4868us (18979us total) trans 4294967917 rc 0/0 00000100:00100000:2.0:1769074951.396090:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 796 00002000:00100000:2.0:1769074951.396103:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x9e:0x0] (0->157) req@ffff916049d23480 x1855007616283264/t4294967917(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.396113:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d23480 with x1855007616283264 ext(0->157) 00002000:00010000:2.0:1769074951.396119:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d23480 00000100:00100000:1.0:1769074951.398695:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2419:x1855007616282112:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6875us (21506us total) trans 4294967924 rc 0/0 00000100:00100000:1.0:1769074951.398722:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 799 00002000:00100000:1.0:1769074951.398736:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x9a:0x0] (0->157) req@ffff9161815fc700 x1855007616282112/t4294967924(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.398747:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fc700 with x1855007616282112 ext(0->157) 00002000:00010000:1.0:1769074951.398754:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fc700 00000100:00100000:1.0:1769074951.398855:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2419:x1855007616283008:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8189us (21790us total) trans 4294967916 rc 0/0 00000100:00100000:1.0:1769074951.398863:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 794 00002000:00100000:1.0:1769074951.398869:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x9d:0x0] (0->157) req@ffff916049d22680 x1855007616283008/t4294967916(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.398878:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d22680 with x1855007616283008 ext(0->157) 00002000:00010000:1.0:1769074951.398883:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d22680 00000100:00100000:1.0:1769074951.398931:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2419:x1855007616284032:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7540us (21795us total) trans 4294967918 rc 0/0 00000100:00100000:1.0:1769074951.398938:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 797 00002000:00100000:1.0:1769074951.398944:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xa1:0x0] (0->157) req@ffff9161815fed80 x1855007616284032/t4294967918(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.398952:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fed80 with x1855007616284032 ext(0->157) 00002000:00010000:1.0:1769074951.398956:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815fed80 00000100:00100000:1.0:1769074951.399005:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2419:x1855007616283776:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7380us (21885us total) trans 4294967919 rc 0/0 00000100:00100000:1.0:1769074951.399015:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 798 00002000:00100000:1.0:1769074951.399021:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xa0:0x0] (0->157) req@ffff9161815fd180 x1855007616283776/t4294967919(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.399029:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd180 with x1855007616283776 ext(0->157) 00002000:00010000:1.0:1769074951.399033:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815fd180 00000100:00100000:1.0:1769074951.399084:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2419:x1855007616283520:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7977us (21983us total) trans 4294967920 rc 0/0 00000100:00100000:1.0:1769074951.399091:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 795 00002000:00100000:1.0:1769074951.399097:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x9f:0x0] (0->157) req@ffff916049d23800 x1855007616283520/t4294967920(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.399105:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049d23800 with x1855007616283520 ext(0->157) 00002000:00010000:1.0:1769074951.399108:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049d23800 00000100:00100000:3.0:1769074951.400854:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2419:x1855007616282368:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8270us (23652us total) trans 4294967925 rc 0/0 00000100:00100000:3.0:1769074951.400875:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 800 00002000:00100000:3.0:1769074951.400887:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0x9b:0x0] (0->157) req@ffff9161815fe680 x1855007616282368/t4294967925(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.400896:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fe680 with x1855007616282368 ext(0->157) 00002000:00010000:3.0:1769074951.400902:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fe680 00000001:00080000:1.0:1769074951.401199:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967912 is committed 00000001:00080000:2.0:1769074951.401445:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967924 is committed 00000100:00100000:0.0:1769074951.405100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.405353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074951.405477:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282624 00000100:00100000:1.0:1769074951.405488:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282624 00002000:00100000:1.0:1769074951.405563:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x9c:0x0] (0->157) req@ffff9161815fd880 x1855007616282624/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405575:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd880 with x1855007616282624 ext(0->157) 00002000:00010000:1.0:1769074951.405581:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fd880 00000100:00100000:1.0:1769074951.405601:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616282880 00000100:00100000:1.0:1769074951.405604:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616282880 00002000:00100000:1.0:1769074951.405618:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x9d:0x0] (0->157) req@ffff9161815fe300 x1855007616282880/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405626:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fe300 with x1855007616282880 ext(0->157) 00002000:00010000:1.0:1769074951.405631:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fe300 00000100:00100000:1.0:1769074951.405643:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283136 00000100:00100000:1.0:1769074951.405646:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283136 00002000:00100000:1.0:1769074951.405659:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x9e:0x0] (0->157) req@ffff9161815fc380 x1855007616283136/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405667:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fc380 with x1855007616283136 ext(0->157) 00002000:00010000:1.0:1769074951.405670:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fc380 00000100:00100000:1.0:1769074951.405680:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283392 00000100:00100000:1.0:1769074951.405683:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283392 00002000:00100000:1.0:1769074951.405696:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x9f:0x0] (0->157) req@ffff9161815ff480 x1855007616283392/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405703:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815ff480 with x1855007616283392 ext(0->157) 00002000:00010000:1.0:1769074951.405707:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815ff480 00000100:00100000:1.0:1769074951.405726:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283648 00000100:00100000:1.0:1769074951.405729:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283648 00002000:00100000:1.0:1769074951.405742:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xa0:0x0] (0->157) req@ffff9161815ff800 x1855007616283648/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405750:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815ff800 with x1855007616283648 ext(0->157) 00002000:00010000:1.0:1769074951.405753:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815ff800 00000100:00100000:1.0:1769074951.405759:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616283904 00000100:00100000:1.0:1769074951.405762:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616283904 00002000:00100000:1.0:1769074951.405773:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xa1:0x0] (0->157) req@ffff9161815fd500 x1855007616283904/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405780:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd500 with x1855007616283904 ext(0->157) 00002000:00010000:1.0:1769074951.405784:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fd500 00000100:00100000:1.0:1769074951.405789:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284160 00000100:00100000:1.0:1769074951.405792:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284160 00002000:00100000:1.0:1769074951.405804:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->157) req@ffff916041f15880 x1855007616284160/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.405812:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041f15880 with x1855007616284160 ext(0->157) 00002000:00010000:1.0:1769074951.405816:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041f15880 00000100:00100000:1.0:1769074951.405827:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 801 00000100:00100000:1.0:1769074951.405835:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2419:x1855007616282624:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.406258:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 802 00000100:00100000:1.0:1769074951.406266:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2419:x1855007616282880:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.406428:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 803 00000100:00100000:1.0:1769074951.406435:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2419:x1855007616283136:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.406627:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 804 00000100:00100000:1.0:1769074951.406633:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2419:x1855007616283392:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.406801:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 805 00000100:00100000:1.0:1769074951.406808:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2419:x1855007616283648:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.406978:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 806 00000100:00100000:1.0:1769074951.406985:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616283904:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.407144:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 807 00000100:00100000:1.0:1769074951.407151:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616284160:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.409967:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2419:x1855007616284160:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2804us (4601us total) trans 4294967932 rc 0/0 00000100:00100000:1.0:1769074951.409990:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 807 00002000:00100000:1.0:1769074951.410006:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa2:0x0] (0->157) req@ffff916041f15880 x1855007616284160/t4294967932(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410016:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041f15880 with x1855007616284160 ext(0->157) 00002000:00010000:1.0:1769074951.410022:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916041f15880 00000100:00100000:1.0:1769074951.410078:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2419:x1855007616283904:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3094us (4759us total) trans 4294967931 rc 0/0 00000100:00100000:1.0:1769074951.410085:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 806 00002000:00100000:1.0:1769074951.410090:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa1:0x0] (0->157) req@ffff9161815fd500 x1855007616283904/t4294967931(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410098:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd500 with x1855007616283904 ext(0->157) 00002000:00010000:1.0:1769074951.410101:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fd500 00000100:00100000:1.0:1769074951.410144:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2419:x1855007616282624:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4310us (5055us total) trans 4294967926 rc 0/0 00000100:00100000:1.0:1769074951.410151:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 801 00002000:00100000:1.0:1769074951.410157:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x9c:0x0] (0->157) req@ffff9161815fd880 x1855007616282624/t4294967926(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410164:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fd880 with x1855007616282624 ext(0->157) 00002000:00010000:1.0:1769074951.410168:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fd880 00000100:00100000:1.0:1769074951.410206:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2419:x1855007616283136:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3771us (4987us total) trans 4294967928 rc 0/0 00000100:00100000:1.0:1769074951.410212:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 803 00002000:00100000:1.0:1769074951.410217:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0x9e:0x0] (0->157) req@ffff9161815fc380 x1855007616283136/t4294967928(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410224:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fc380 with x1855007616283136 ext(0->157) 00002000:00010000:1.0:1769074951.410227:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fc380 00000100:00100000:1.0:1769074951.410263:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+223:2419:x1855007616283392:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3630us (5006us total) trans 4294967929 rc 0/0 00000100:00100000:1.0:1769074951.410269:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 804 00002000:00100000:1.0:1769074951.410274:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x9f:0x0] (0->157) req@ffff9161815ff480 x1855007616283392/t4294967929(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410281:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815ff480 with x1855007616283392 ext(0->157) 00002000:00010000:1.0:1769074951.410284:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815ff480 00000100:00100000:1.0:1769074951.410321:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2419:x1855007616283648:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3513us (5034us total) trans 4294967930 rc 0/0 00000100:00100000:1.0:1769074951.410328:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 805 00002000:00100000:1.0:1769074951.410334:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa0:0x0] (0->157) req@ffff9161815ff800 x1855007616283648/t4294967930(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.410341:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815ff800 with x1855007616283648 ext(0->157) 00002000:00010000:1.0:1769074951.410344:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815ff800 00000100:00100000:3.0:1769074951.419031:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.419078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.419115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.419141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.419186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.419215:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284544 00000100:00100000:3.0:1769074951.419226:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284544 00002000:00100000:3.0:1769074951.419273:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa7:0x0] (0->157) req@ffff91617b57fb80 x1855007616284544/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.419284:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57fb80 with x1855007616284544 ext(0->157) 00002000:00010000:3.0:1769074951.419291:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617b57fb80 00000100:00100000:3.0:1769074951.419311:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284672 00000100:00100000:3.0:1769074951.419314:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284672 00002000:00100000:3.0:1769074951.419342:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa3:0x0] (0->157) req@ffff91617b57df80 x1855007616284672/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.419349:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57df80 with x1855007616284672 ext(0->157) 00002000:00010000:3.0:1769074951.419353:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617b57df80 00000100:00100000:3.0:1769074951.419364:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284928 00000100:00100000:3.0:1769074951.419367:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284928 00002000:00100000:3.0:1769074951.419380:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa5:0x0] (0->157) req@ffff916042a43100 x1855007616284928/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.419394:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916042a43100 with x1855007616284928 ext(0->157) 00002000:00010000:3.0:1769074951.419397:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916042a43100 00000100:00100000:3.0:1769074951.419408:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284800 00000100:00100000:3.0:1769074951.419935:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284800 00002000:00100000:3.0:1769074951.419961:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa8:0x0] (0->157) req@ffff916045a5ce00 x1855007616284800/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.419968:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5ce00 with x1855007616284800 ext(0->157) 00002000:00010000:3.0:1769074951.419971:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5ce00 00000100:00100000:3.0:1769074951.420001:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 808 00000100:00100000:3.0:1769074951.420010:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616284544:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.420562:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616284416 00000100:00100000:0.0:1769074951.420568:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616284416 00000100:00100000:0.0:1769074951.420596:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2904 00000100:00100000:0.0:1769074951.420603:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616284416:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:0.0:1769074951.420674:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616284416:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 72us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.420681:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2904 00000100:00100000:0.0:1769074951.420819:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 809 00000100:00100000:0.0:1769074951.420827:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616284672:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.421054:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 810 00000100:00100000:0.0:1769074951.421061:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2420:x1855007616284928:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.421227:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 811 00000100:00100000:0.0:1769074951.421235:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2419:x1855007616284800:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.426228:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2419:x1855007616282880:12345-192.168.204.32@tcp:4:cp.0 Request processed in 19951us (21042us total) trans 4294967927 rc 0/0 00000100:00100000:2.0:1769074951.426245:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 802 00002000:00100000:2.0:1769074951.426259:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x9d:0x0] (0->157) req@ffff9161815fe300 x1855007616282880/t4294967927(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.426269:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815fe300 with x1855007616282880 ext(0->157) 00002000:00010000:2.0:1769074951.426276:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9161815fe300 00000100:00100000:3.0:1769074951.426635:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2420:x1855007616284544:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6624us (7555us total) trans 4294967924 rc 0/0 00000100:00100000:3.0:1769074951.426644:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 808 00002000:00100000:3.0:1769074951.426650:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa7:0x0] (0->157) req@ffff91617b57fb80 x1855007616284544/t4294967924(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.426658:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57fb80 with x1855007616284544 ext(0->157) 00002000:00010000:3.0:1769074951.426662:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617b57fb80 00000100:00100000:2.0:1769074951.427606:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2420:x1855007616284928:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6540us (8459us total) trans 4294967922 rc 0/0 00000100:00100000:2.0:1769074951.427616:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 810 00002000:00100000:2.0:1769074951.427624:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xa5:0x0] (0->157) req@ffff916042a43100 x1855007616284928/t4294967922(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.427633:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916042a43100 with x1855007616284928 ext(0->157) 00002000:00010000:2.0:1769074951.427637:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916042a43100 00000100:00100000:1.0:1769074951.427952:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+231:2420:x1855007616284672:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7124us (8834us total) trans 4294967921 rc 0/0 00000100:00100000:1.0:1769074951.427960:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 809 00002000:00100000:1.0:1769074951.427967:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->157) req@ffff91617b57df80 x1855007616284672/t4294967921(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.427975:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617b57df80 with x1855007616284672 ext(0->157) 00002000:00010000:1.0:1769074951.427980:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617b57df80 00000100:00100000:3.0:1769074951.428359:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2419:x1855007616284800:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7123us (9170us total) trans 4294967923 rc 0/0 00000100:00100000:3.0:1769074951.428367:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 811 00002000:00100000:3.0:1769074951.428373:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xa8:0x0] (0->157) req@ffff916045a5ce00 x1855007616284800/t4294967923(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.428382:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5ce00 with x1855007616284800 ext(0->157) 00002000:00010000:3.0:1769074951.428386:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5ce00 00000100:00100000:2.0:1769074951.428806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.428851:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.428898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.428925:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285184 00000100:00100000:2.0:1769074951.428933:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285184 00002000:00100000:2.0:1769074951.428972:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa8:0x0] (0->157) req@ffff916052a42a00 x1855007616285184/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.428981:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a42a00 with x1855007616285184 ext(0->157) 00002000:00010000:2.0:1769074951.428985:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916052a42a00 00000100:00100000:2.0:1769074951.429001:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285056 00000100:00100000:2.0:1769074951.429004:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285056 00002000:00100000:2.0:1769074951.429018:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa5:0x0] (0->157) req@ffff916052a43800 x1855007616285056/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.429025:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a43800 with x1855007616285056 ext(0->157) 00002000:00010000:2.0:1769074951.429029:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916052a43800 00000100:00100000:2.0:1769074951.429040:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285312 00000100:00100000:2.0:1769074951.429043:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285312 00002000:00100000:2.0:1769074951.429056:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xa2:0x0] (0->157) req@ffff916044b12300 x1855007616285312/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.429064:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12300 with x1855007616285312 ext(0->157) 00002000:00010000:2.0:1769074951.429067:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b12300 00000100:00100000:2.0:1769074951.429080:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 812 00000100:00100000:2.0:1769074951.429087:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2420:x1855007616285184:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.429632:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 813 00000100:00100000:3.0:1769074951.429643:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2420:x1855007616285056:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.429913:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 814 00000100:00100000:3.0:1769074951.429920:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2420:x1855007616285312:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.435286:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2420:x1855007616285056:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5634us (6422us total) trans 4294967933 rc 0/0 00000100:00100000:3.0:1769074951.435300:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 813 00002000:00100000:3.0:1769074951.435314:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa5:0x0] (0->157) req@ffff916052a43800 x1855007616285056/t4294967933(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.435335:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a43800 with x1855007616285056 ext(0->157) 00002000:00010000:3.0:1769074951.435343:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916052a43800 00000100:00100000:0.0:1769074951.437311:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2420:x1855007616285312:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7381us (8402us total) trans 4294967925 rc 0/0 00000100:00100000:0.0:1769074951.437325:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 814 00002000:00100000:0.0:1769074951.437338:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa2:0x0] (0->157) req@ffff916044b12300 x1855007616285312/t4294967925(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.437348:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12300 with x1855007616285312 ext(0->157) 00002000:00010000:0.0:1769074951.437354:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b12300 00000100:00100000:0.0:1769074951.439504:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916052a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+225:2420:x1855007616285184:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10406us (10689us total) trans 4294967934 rc 0/0 00000100:00100000:0.0:1769074951.439517:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 812 00002000:00100000:0.0:1769074951.439575:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa8:0x0] (0->157) req@ffff916052a42a00 x1855007616285184/t4294967934(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.439586:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916052a42a00 with x1855007616285184 ext(0->157) 00002000:00010000:0.0:1769074951.439592:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916052a42a00 00000100:00100000:2.0:1769074951.440458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440645:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440660:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.440735:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285568 00000100:00100000:2.0:1769074951.440745:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285568 00002000:00100000:2.0:1769074951.440789:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa9:0x0] (0->157) req@ffff916044b13480 x1855007616285568/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440799:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13480 with x1855007616285568 ext(0->157) 00002000:00010000:2.0:1769074951.440804:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13480 00000100:00100000:2.0:1769074951.440820:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285824 00000100:00100000:2.0:1769074951.440823:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285824 00002000:00100000:2.0:1769074951.440837:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xaa:0x0] (0->157) req@ffff916044b10700 x1855007616285824/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440845:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b10700 with x1855007616285824 ext(0->157) 00002000:00010000:2.0:1769074951.440849:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b10700 00000100:00100000:2.0:1769074951.440862:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286080 00000100:00100000:2.0:1769074951.440865:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286080 00002000:00100000:2.0:1769074951.440885:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xab:0x0] (0->157) req@ffff916044b13100 x1855007616286080/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440892:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13100 with x1855007616286080 ext(0->157) 00002000:00010000:2.0:1769074951.440895:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13100 00000100:00100000:2.0:1769074951.440907:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285696 00000100:00100000:2.0:1769074951.440909:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285696 00002000:00100000:2.0:1769074951.440921:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa6:0x0] (0->157) req@ffff916044b12a00 x1855007616285696/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440928:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12a00 with x1855007616285696 ext(0->157) 00002000:00010000:2.0:1769074951.440932:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12a00 00000100:00100000:2.0:1769074951.440942:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285952 00000100:00100000:2.0:1769074951.440945:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285952 00002000:00100000:2.0:1769074951.440958:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa3:0x0] (0->157) req@ffff916044b12680 x1855007616285952/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440965:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12680 with x1855007616285952 ext(0->157) 00002000:00010000:2.0:1769074951.440969:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12680 00000100:00100000:2.0:1769074951.440976:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286208 00000100:00100000:2.0:1769074951.440978:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286208 00002000:00100000:2.0:1769074951.440990:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa7:0x0] (0->157) req@ffff916044b13800 x1855007616286208/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.440997:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13800 with x1855007616286208 ext(0->157) 00002000:00010000:2.0:1769074951.441000:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13800 00000100:00100000:2.0:1769074951.441006:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616285440 00000100:00100000:2.0:1769074951.441008:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616285440 00002000:00100000:2.0:1769074951.441020:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xaa:0x0] (0->157) req@ffff916044b11500 x1855007616285440/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.441033:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11500 with x1855007616285440 ext(0->157) 00002000:00010000:2.0:1769074951.441037:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b11500 00000100:00100000:2.0:1769074951.441047:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 815 00000100:00100000:2.0:1769074951.441055:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2420:x1855007616285568:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.441458:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 816 00000100:00100000:2.0:1769074951.441466:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2420:x1855007616285824:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.441654:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 817 00000100:00100000:2.0:1769074951.441661:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2420:x1855007616286080:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.441833:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 818 00000100:00100000:2.0:1769074951.441840:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2420:x1855007616285696:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.442465:0:24956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286336 00000100:00100000:3.0:1769074951.442474:0:24956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286336 00000100:00100000:3.0:1769074951.442562:0:24956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2905 00000100:00100000:3.0:1769074951.442570:0:24956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2418:x1855007616286336:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:3.0:1769074951.442663:0:24956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2418:x1855007616286336:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 93us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.442670:0:24956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2905 00000100:00100000:3.0:1769074951.442804:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 819 00000100:00100000:3.0:1769074951.442813:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616285952:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.443393:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 820 00000100:00100000:1.0:1769074951.443405:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2420:x1855007616286208:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.443670:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 821 00000100:00100000:1.0:1769074951.443679:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2420:x1855007616285440:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.445008:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616285952:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2187us (4338us total) trans 4294967939 rc 0/0 00000100:00100000:3.0:1769074951.445024:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 819 00002000:00100000:3.0:1769074951.445035:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xa3:0x0] (0->157) req@ffff916044b12680 x1855007616285952/t4294967939(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445044:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12680 with x1855007616285952 ext(0->157) 00002000:00010000:3.0:1769074951.445050:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12680 00000100:00100000:3.0:1769074951.445115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445246:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074951.445288:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286592 00000100:00100000:3.0:1769074951.445295:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286592 00002000:00100000:3.0:1769074951.445336:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xab:0x0] (0->157) req@ffff916045a5e300 x1855007616286592/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445345:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5e300 with x1855007616286592 ext(0->157) 00002000:00010000:3.0:1769074951.445349:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5e300 00000100:00100000:3.0:1769074951.445359:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286464 00000100:00100000:3.0:1769074951.445362:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286464 00002000:00100000:3.0:1769074951.445375:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xa6:0x0] (0->157) req@ffff916045a5d880 x1855007616286464/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445383:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5d880 with x1855007616286464 ext(0->157) 00002000:00010000:3.0:1769074951.445387:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5d880 00000100:00100000:3.0:1769074951.445393:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286720 00000100:00100000:3.0:1769074951.445396:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286720 00002000:00100000:3.0:1769074951.445409:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xa4:0x0] (0->157) req@ffff916045a5c700 x1855007616286720/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445416:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5c700 with x1855007616286720 ext(0->157) 00002000:00010000:3.0:1769074951.445420:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5c700 00000100:00100000:3.0:1769074951.445425:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286976 00000100:00100000:3.0:1769074951.445428:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286976 00002000:00100000:3.0:1769074951.445438:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xa9:0x0] (0->157) req@ffff916045a5fb80 x1855007616286976/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445446:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5fb80 with x1855007616286976 ext(0->157) 00002000:00010000:3.0:1769074951.445449:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5fb80 00000100:00100000:3.0:1769074951.445455:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616286848 00000100:00100000:3.0:1769074951.445457:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616286848 00002000:00100000:3.0:1769074951.445468:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xac:0x0] (0->157) req@ffff916045a5ca80 x1855007616286848/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445474:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5ca80 with x1855007616286848 ext(0->157) 00002000:00010000:3.0:1769074951.445478:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a5ca80 00000100:00100000:3.0:1769074951.445484:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287104 00000100:00100000:3.0:1769074951.445486:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287104 00002000:00100000:3.0:1769074951.445495:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xa4:0x0] (0->157) req@ffff916044ce7100 x1855007616287104/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.445503:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044ce7100 with x1855007616287104 ext(0->157) 00002000:00010000:3.0:1769074951.445507:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044ce7100 00000100:00100000:3.0:1769074951.445518:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 822 00000100:00100000:3.0:1769074951.445525:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616286592:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074951.446585:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 823 00000100:00100000:0.0:1769074951.446600:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2420:x1855007616286464:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.447073:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2420:x1855007616285440:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3393us (6368us total) trans 4294967926 rc 0/0 00000100:00100000:1.0:1769074951.447082:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 821 00002000:00100000:1.0:1769074951.447091:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xaa:0x0] (0->157) req@ffff916044b11500 x1855007616285440/t4294967926(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.447099:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11500 with x1855007616285440 ext(0->157) 00002000:00010000:1.0:1769074951.447104:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b11500 00000100:00100000:1.0:1769074951.447127:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 824 00000100:00100000:1.0:1769074951.447134:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2420:x1855007616286720:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.447400:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 825 00000100:00100000:1.0:1769074951.447408:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616286976:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.448240:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616285824:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6769us (7622us total) trans 4294967936 rc 0/0 00000100:00100000:2.0:1769074951.448250:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 816 00002000:00100000:2.0:1769074951.448259:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xaa:0x0] (0->157) req@ffff916044b10700 x1855007616285824/t4294967936(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.448267:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b10700 with x1855007616285824 ext(0->157) 00002000:00010000:2.0:1769074951.448272:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b10700 00000100:00100000:2.0:1769074951.448296:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 826 00000100:00100000:2.0:1769074951.448304:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2419:x1855007616286848:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.448960:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616286080:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7294us (8326us total) trans 4294967937 rc 0/0 00000100:00100000:3.0:1769074951.448971:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 817 00002000:00100000:3.0:1769074951.448979:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xab:0x0] (0->157) req@ffff916044b13100 x1855007616286080/t4294967937(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.448987:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13100 with x1855007616286080 ext(0->157) 00002000:00010000:3.0:1769074951.448991:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13100 00000100:00100000:3.0:1769074951.449010:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 827 00000100:00100000:3.0:1769074951.449017:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616287104:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074951.449263:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616285696:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7422us (8616us total) trans 4294967938 rc 0/0 00000100:00100000:3.0:1769074951.449271:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 818 00002000:00100000:3.0:1769074951.449277:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xa6:0x0] (0->157) req@ffff916044b12a00 x1855007616285696/t4294967938(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074951.449285:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12a00 with x1855007616285696 ext(0->157) 00002000:00010000:3.0:1769074951.449289:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12a00 00000100:00100000:0.0:1769074951.449582:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2420:x1855007616286208:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6179us (8897us total) trans 4294967940 rc 0/0 00000100:00100000:0.0:1769074951.449590:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 820 00002000:00100000:0.0:1769074951.449597:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa7:0x0] (0->157) req@ffff916044b13800 x1855007616286208/t4294967940(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.449604:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13800 with x1855007616286208 ext(0->157) 00002000:00010000:0.0:1769074951.449608:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13800 00000100:00100000:0.0:1769074951.449698:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616286592:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4173us (4582us total) trans 4294967930 rc 0/0 00000100:00100000:0.0:1769074951.449705:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 822 00002000:00100000:0.0:1769074951.449722:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xab:0x0] (0->157) req@ffff916045a5e300 x1855007616286592/t4294967930(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.449730:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5e300 with x1855007616286592 ext(0->157) 00002000:00010000:0.0:1769074951.449733:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5e300 00000100:00100000:1.0:1769074951.450235:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2420:x1855007616285568:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9179us (9779us total) trans 4294967935 rc 0/0 00000100:00100000:1.0:1769074951.450243:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 815 00002000:00100000:1.0:1769074951.450249:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa9:0x0] (0->157) req@ffff916044b13480 x1855007616285568/t4294967935(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.450257:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13480 with x1855007616285568 ext(0->157) 00002000:00010000:1.0:1769074951.450261:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13480 00000100:00100000:1.0:1769074951.450334:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2419:x1855007616286976:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2927us (5086us total) trans 4294967929 rc 0/0 00000100:00100000:1.0:1769074951.450341:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 825 00002000:00100000:1.0:1769074951.450346:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xa9:0x0] (0->157) req@ffff916045a5fb80 x1855007616286976/t4294967929(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.450353:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5fb80 with x1855007616286976 ext(0->157) 00002000:00010000:1.0:1769074951.450356:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5fb80 00000100:00100000:2.0:1769074951.452190:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2419:x1855007616286848:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3875us (6919us total) trans 4294967942 rc 0/0 00000100:00100000:2.0:1769074951.452205:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 826 00002000:00100000:2.0:1769074951.452218:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xac:0x0] (0->157) req@ffff916045a5ca80 x1855007616286848/t4294967942(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.452228:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5ca80 with x1855007616286848 ext(0->157) 00002000:00010000:2.0:1769074951.452233:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a5ca80 00000100:00100000:0.0:1769074951.456230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074951.456630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074951.456789:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616286720:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9652us (11552us total) trans 4294967928 rc 0/0 00000100:00100000:1.0:1769074951.456802:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 824 00002000:00100000:1.0:1769074951.456820:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xa4:0x0] (0->157) req@ffff916045a5c700 x1855007616286720/t4294967928(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.456831:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5c700 with x1855007616286720 ext(0->157) 00002000:00010000:1.0:1769074951.456838:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5c700 00000100:00100000:1.0:1769074951.456864:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287232 00000100:00100000:1.0:1769074951.456949:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287232 00002000:00100000:1.0:1769074951.456993:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xac:0x0] (0->157) req@ffff916041f15500 x1855007616287232/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.457002:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041f15500 with x1855007616287232 ext(0->157) 00002000:00010000:1.0:1769074951.457006:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041f15500 00000100:00100000:1.0:1769074951.457030:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 828 00000100:00100000:1.0:1769074951.457038:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2420:x1855007616287232:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074951.458738:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616287232:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1690us (2098us total) trans 4294967931 rc 0/0 00000100:00100000:1.0:1769074951.458753:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 828 00002000:00100000:1.0:1769074951.458764:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xac:0x0] (0->157) req@ffff916041f15500 x1855007616287232/t4294967931(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074951.458773:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916041f15500 with x1855007616287232 ext(0->157) 00002000:00010000:1.0:1769074951.458778:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916041f15500 00000100:00100000:3.0:1769074951.458858:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287360 00000100:00100000:3.0:1769074951.458865:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287360 00000100:00100000:3.0:1769074951.458910:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2906 00000100:00100000:3.0:1769074951.458919:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616287360:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:0.0:1769074951.462690:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2420:x1855007616286464:12345-192.168.204.32@tcp:4:cp.0 Request processed in 16080us (17462us total) trans 4294967927 rc 0/0 00000100:00100000:0.0:1769074951.462706:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 823 00002000:00100000:0.0:1769074951.462731:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xa6:0x0] (0->157) req@ffff916045a5d880 x1855007616286464/t4294967927(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074951.462742:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a5d880 with x1855007616286464 ext(0->157) 00002000:00010000:0.0:1769074951.462749:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a5d880 00000001:00080000:0.0:1769074951.465430:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967931 is committed 00000100:00100000:3.0:1769074951.465684:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2420:x1855007616287360:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 6761us (9460us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.465696:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2906 00000100:00100000:2.0:1769074951.467146:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616287104:12345-192.168.204.32@tcp:4:cp.0 Request processed in 18120us (21861us total) trans 4294967941 rc 0/0 00000100:00100000:2.0:1769074951.467158:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 827 00002000:00100000:2.0:1769074951.467173:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xa4:0x0] (0->157) req@ffff916044ce7100 x1855007616287104/t4294967941(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.467183:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044ce7100 with x1855007616287104 ext(0->157) 00002000:00010000:2.0:1769074951.467189:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044ce7100 00000100:00100000:1.0:1769074951.478084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.479003:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287488 00000100:00100000:2.0:1769074951.479017:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287488 00002000:00100000:2.0:1769074951.479075:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xad:0x0] (0->157) req@ffff91617f973100 x1855007616287488/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/0 e 0 to 0 dl 1769074962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.479088:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f973100 with x1855007616287488 ext(0->157) 00002000:00010000:2.0:1769074951.479095:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f973100 00000100:00100000:2.0:1769074951.479131:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 829 00000100:00100000:2.0:1769074951.479140:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2419:x1855007616287488:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074951.480097:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2419:x1855007616287488:12345-192.168.204.32@tcp:4:cp.0 Request processed in 953us (2019us total) trans 4294967943 rc 0/0 00000100:00100000:2.0:1769074951.480108:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 829 00002000:00100000:2.0:1769074951.480117:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xad:0x0] (0->157) req@ffff91617f973100 x1855007616287488/t4294967943(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:487/0 lens 648/448 e 0 to 0 dl 1769074962 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074951.480125:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f973100 with x1855007616287488 ext(0->157) 00002000:00010000:2.0:1769074951.480130:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f973100 00000100:00100000:1.0:1769074951.480272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074951.481004:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287616 00000100:00100000:2.0:1769074951.481014:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287616 00000100:00100000:2.0:1769074951.481067:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2907 00000100:00100000:2.0:1769074951.481077:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2419:x1855007616287616:12345-192.168.204.32@tcp:16:kworker.0 00000001:00080000:0.0:1769074951.482832:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967943 is committed 00000100:00100000:2.0:1769074951.483164:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2419:x1855007616287616:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 2083us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074951.483174:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2907 00000100:00100000:0.0:1769074951.604179:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1769074951.604204:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626658432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1769074951.604273:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074951.604687:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626658560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1769074951.604733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074951.604766:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658560 00000100:00100000:1.0:1769074951.604774:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658560 00000100:00100000:1.0:1769074951.604821:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1769074951.604831:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626658560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1769074951.604864:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:1.0:1769074951.604910:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626658560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074951.604918:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1769074951.604959:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658432 00000100:00100000:1.0:1769074951.604963:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658432 00000100:00100000:1.0:1769074951.604997:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1769074951.605003:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626658432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1769074951.605016:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1662976 granted 490899520 pending 0 free 3915386880 avail 3683033088 00000100:00100000:1.0:1769074951.605044:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626658432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074951.605050:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1769074951.605199:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626658432:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1769074951.605231:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074951.605606:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626658560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074951.605770:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626658816:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.605806:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.605832:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626659328:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.605851:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.605869:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626659840:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.605891:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.605907:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1769074951.605912:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626658944:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.605934:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.605949:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626659456:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.605968:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.605984:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1855007626659968:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.606001:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074951.606027:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658816 00000100:00100000:0.0:1769074951.606032:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658816 00000100:00100000:0.0:1769074951.606063:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659328 00000100:00100000:0.0:1769074951.606066:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659328 00000100:00100000:0.0:1769074951.606087:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658944 00000100:00100000:0.0:1769074951.606090:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658944 00000100:00100000:0.0:1769074951.606104:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659968 00000100:00100000:0.0:1769074951.606107:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659968 00000100:00100000:0.0:1769074951.606120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:0.0:1769074951.606127:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626658816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.606177:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626658816:12345-0@lo:400:kworker.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.606184:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:0.0:1769074951.606199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:0.0:1769074951.606205:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626659328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.606229:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626659328:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.606234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:0.0:1769074951.606245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:0.0:1769074951.606250:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626658944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.606274:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626658944:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.606280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:0.0:1769074951.606290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:0.0:1769074951.606297:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1855007626659968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606553:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626659072:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606584:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.606607:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626659584:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.606649:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1769074951.606655:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626658688:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.606703:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626659200:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.606745:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626659712:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606764:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.606789:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626658688 00000100:00100000:3.0:1769074951.606793:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626658688 00000100:00100000:3.0:1769074951.606821:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1769074951.606827:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626658688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606858:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626658688:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.606864:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1769074951.606890:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659840 00000100:00100000:3.0:1769074951.606894:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659840 00000100:00100000:3.0:1769074951.606918:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659456 00000100:00100000:3.0:1769074951.606921:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659456 00000100:00100000:3.0:1769074951.606936:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659712 00000100:00100000:3.0:1769074951.606939:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659712 00000100:00100000:3.0:1769074951.606956:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1769074951.606961:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626659840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.606987:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626659840:12345-0@lo:400:kworker.0 Request processed in 26us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.606992:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1769074951.607003:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1769074951.607009:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626659456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607034:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626659456:12345-0@lo:400:kworker.0 Request processed in 25us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.607039:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1769074951.607049:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1769074951.607055:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626659712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607079:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626659712:12345-0@lo:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.607084:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1769074951.607106:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659584 00000100:00100000:3.0:1769074951.607109:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659584 00000100:00100000:3.0:1769074951.607129:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1769074951.607134:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626659584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607161:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626659584:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.607165:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1769074951.607182:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659072 00000100:00100000:3.0:1769074951.607185:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659072 00000100:00100000:3.0:1769074951.607200:0:25310:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626659200 00000100:00100000:3.0:1769074951.607203:0:25310:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626659200 00000100:00100000:3.0:1769074951.607216:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194 00000100:00100000:3.0:1769074951.607221:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626659072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607247:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626659072:12345-0@lo:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.607253:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194 00000100:00100000:3.0:1769074951.607668:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1769074951.607677:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626659200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607722:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626659200:12345-0@lo:400:kworker.0 Request processed in 47us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.607728:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1769074951.607762:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626658688:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607774:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626659200:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607782:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626659712:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607790:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626659072:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607798:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626659584:0@lo:400:kworker.0 00000100:00080000:3.0:1769074951.607880:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1769074951.607885:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1769074951.607888:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1769074951.607890:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074951.607909:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626658944:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607920:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626659456:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607931:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626658816:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607940:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626659328:0@lo:400:kworker.0 00000100:00100000:3.0:1769074951.607950:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626659840:0@lo:400:kworker.0 00000100:00100000:0.0:1769074951.608551:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1855007626659968:12345-0@lo:400:kworker.0 Request processed in 2251us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074951.608559:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00100000:1.0:1769074951.608703:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1769074951.608767:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1855007626659968:0@lo:400:kworker.0 00000100:00100000:1.0:1769074951.610727:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626660096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074951.610798:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074951.610975:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660096 00000100:00100000:3.0:1769074951.610986:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660096 00000100:00100000:3.0:1769074951.611042:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1769074951.611052:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626660096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1769074951.611088:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:2.0:1769074951.611268:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626660096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1769074951.611462:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626660096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 410us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074951.611471:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1769074952.117054:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1769074952.117078:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626660224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074952.117148:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074952.117264:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660224 00000100:00100000:1.0:1769074952.117273:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660224 00000100:00100000:1.0:1769074952.117328:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1769074952.117337:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626660224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1769074952.117370:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1662976 granted 490899520 pending 0 free 3915386880 avail 3683033088 00000100:00100000:1.0:1769074952.117412:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626660224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074952.117420:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1769074952.117669:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626660224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769074952.117813:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626660352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1769074952.117845:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074952.117923:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660352 00000100:00100000:0.0:1769074952.117927:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660352 00000100:00100000:0.0:1769074952.117960:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1769074952.117968:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626660352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1769074952.117985:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1576960 granted 490936384 pending 0 free 3764092928 avail 3532570624 00000100:00100000:0.0:1769074952.118026:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626660352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074952.118032:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1769074952.118105:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626660352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1769074952.371810:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769074953.395787:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1769074954.291786:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1769074954.291798:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769074954.292396:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1769074954.292407:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1769074954.419987:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074954.957154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074954.957193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074954.957209:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287744 00000100:00100000:3.0:1769074954.957220:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287744 00000100:00100000:0.0:1769074954.957238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074954.957277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074954.957292:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 285 00000100:00100000:0.0:1769074954.957304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074954.957305:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916042f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2419:x1855007616287744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074954.957344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074954.957365:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916042f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2419:x1855007616287744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074954.957371:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 285 00000100:00100000:0.0:1769074954.957376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074954.957404:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288000 00000100:00100000:3.0:1769074954.957407:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288000 00000100:00100000:3.0:1769074954.957431:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288512 00000100:00100000:3.0:1769074954.957433:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288512 00000100:00100000:2.0:1769074954.957505:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288256 00000100:00100000:2.0:1769074954.957510:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288256 00000100:00100000:2.0:1769074954.957566:0:25313:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288128 00000100:00100000:2.0:1769074954.957569:0:25313:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288128 00000100:00100000:1.0:1769074954.959052:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616287872 00000100:00100000:1.0:1769074954.959062:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616287872 00000100:00100000:2.0:1769074954.959771:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2126 00000100:00100000:1.0:1769074954.959777:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288384 00000100:00100000:1.0:1769074954.959781:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288384 00000100:00100000:2.0:1769074954.959788:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2419:x1855007616288256:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074954.959804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3196 00000100:00100000:1.0:1769074954.959810:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2419:x1855007616288000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074954.959868:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2419:x1855007616288000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 59us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074954.959872:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3196 00000100:00100000:1.0:1769074954.959885:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3197 00000100:00100000:1.0:1769074954.959889:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2419:x1855007616288512:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074954.959915:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2419:x1855007616288512:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074954.959917:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2419:x1855007616288256:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 133us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074954.959931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3197 00000100:00100000:2.0:1769074954.959936:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2126 00000100:00100000:1.0:1769074954.959943:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3198 00000100:00100000:1.0:1769074954.959952:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2419:x1855007616287872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074954.959962:0:25313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2127 00000100:00100000:2.0:1769074954.959972:0:25313:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2419:x1855007616288128:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074954.959982:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2419:x1855007616287872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 31us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074954.959989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3198 00000100:00100000:2.0:1769074954.960006:0:25313:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2419:x1855007616288128:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 35us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074954.960007:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3199 00000100:00100000:2.0:1769074954.960019:0:25313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2127 00000100:00100000:1.0:1769074954.960020:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2419:x1855007616288384:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074954.960043:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2419:x1855007616288384:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 28us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074954.960047:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3199 00000100:00080000:1.0:1769074954.960103:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769074954.960107:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1769074954.960110:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1769074954.960113:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1769074955.192427:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1769074955.192452:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626660480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1769074955.192519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074955.192700:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660480 00000100:00100000:1.0:1769074955.192709:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660480 00000100:00100000:1.0:1769074955.192788:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1769074955.192799:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626660480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1769074955.192828:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1576960 granted 490936384 pending 0 free 3764092928 avail 3532570624 00000100:00100000:1.0:1769074955.192871:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1855007626660480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074955.192878:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1769074955.192973:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626660480:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1769074955.193046:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1769074955.197922:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1769074955.197932:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1769074955.198514:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1769074955.198527:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1769074955.444268:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1769074956.468355:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1769074956.724918:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626660736:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.724986:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725023:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660736 00000100:00100000:3.0:1769074956.725031:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660736 00000100:00100000:1.0:1769074956.725045:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626661248:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725068:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725077:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1769074956.725085:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626661760:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725085:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1855007626660736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725101:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725120:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1769074956.725126:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626660608:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725133:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1855007626660736:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.725140:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1769074956.725147:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725154:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661760 00000100:00100000:3.0:1769074956.725158:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661760 00000100:00100000:1.0:1769074956.725166:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1855007626661120:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725170:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1769074956.725175:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626661760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725187:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725199:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626661760:12345-0@lo:400:kworker.0 Request processed in 23us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.725201:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626661632:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725206:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1769074956.725220:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725226:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660608 00000100:00100000:3.0:1769074956.725229:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660608 00000100:00100000:1.0:1769074956.725233:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626662144:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725252:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1769074956.725257:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618163b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626660608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725280:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626660736:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725280:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618163b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3655:x1855007626660608:12345-0@lo:400:kworker.0 Request processed in 24us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.725286:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1769074956.725289:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626661760:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725309:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e86036b9-84bb-449e-baba-8ef95d66b0fb:3655:1855007626660608:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725312:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661120 00000100:00100000:3.0:1769074956.725315:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661120 00000100:00100000:1.0:1769074956.725324:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626660864:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725346:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725364:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626661376:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725381:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725396:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626661888:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725431:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1769074956.725435:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626660992:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725453:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725469:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626661504:0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074956.725502:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626662016:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725506:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662144 00000100:00100000:3.0:1769074956.725510:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662144 00000100:00100000:1.0:1769074956.725519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.725521:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660864 00000100:00100000:3.0:1769074956.725524:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660864 00000100:00100000:3.0:1769074956.725556:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661376 00000100:00100000:3.0:1769074956.725559:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661376 00000100:00100000:1.0:1769074956.725566:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661248 00000100:00100000:1.0:1769074956.725569:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661248 00000100:00100000:3.0:1769074956.725570:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626660992 00000100:00100000:3.0:1769074956.725572:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626660992 00000100:00100000:3.0:1769074956.725582:0:25081:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661504 00000100:00100000:3.0:1769074956.725584:0:25081:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661504 00000100:00100000:1.0:1769074956.725593:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661632 00000100:00100000:1.0:1769074956.725596:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661632 00000100:00100000:3.0:1769074956.725597:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:3.0:1769074956.725601:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1855007626661120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725610:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626661888 00000100:00100000:1.0:1769074956.725613:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626661888 00000100:00100000:3.0:1769074956.725649:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1855007626661120:12345-0@lo:400:kworker.0 Request processed in 47us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.725656:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1769074956.725660:0:8405:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662016 00000100:00100000:1.0:1769074956.725662:0:8405:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662016 00000100:00100000:3.0:1769074956.725666:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:3.0:1769074956.725672:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626662144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725676:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1769074956.725681:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626661248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725696:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1855007626662144:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.725702:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1769074956.725704:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626661248:12345-0@lo:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.725709:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:3.0:1769074956.725712:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:3.0:1769074956.725717:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725718:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1769074956.725723:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626661632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.725743:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626661632:12345-0@lo:400:kworker.0 Request processed in 20us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.725743:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626660864:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.725750:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:3.0:1769074956.725750:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:1.0:1769074956.725760:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1769074956.725760:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1769074956.725767:0:8405:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626661888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.725767:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626661376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074956.725960:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1769074956.725968:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626662272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1769074956.726023:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1769074956.726031:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626662016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.726075:0:8405:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626661888:12345-0@lo:400:kworker.0 Request processed in 308us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.726075:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1855007626661376:12345-0@lo:400:kworker.0 Request processed in 308us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.726082:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1769074956.726082:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:3.0:1769074956.726094:0:25081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:3.0:1769074956.726100:0:25081:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074956.726104:0:25310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:1.0:1769074956.726110:0:25310:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626661504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726126:0:25081:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1855007626660992:12345-0@lo:400:kworker.0 Request processed in 27us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.726131:0:25310:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626661504:12345-0@lo:400:kworker.0 Request processed in 22us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.726131:0:25081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1769074956.726136:0:25310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00080000:3.0:1769074956.726151:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1769074956.726156:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1769074956.726158:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1769074956.726160:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074956.726164:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1769074956.726171:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626662400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1769074956.726190:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1855007626660992:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726199:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626661504:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726210:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626660864:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726218:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916045a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1855007626661376:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726226:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626661888:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726253:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1855007626661120:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726261:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626661632:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726270:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1855007626662144:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726278:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91615e544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626661248:0@lo:400:kworker.0 00000100:00100000:3.0:1769074956.726605:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1769074956.726613:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626662528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1769074956.726654:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.726682:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662528 00000100:00100000:3.0:1769074956.726686:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662528 00000100:00100000:3.0:1769074956.726714:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1769074956.726720:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626662528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1769074956.726749:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:3.0:1769074956.726798:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626662528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.726804:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1769074956.726833:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.726835:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b0f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626662528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074956.726860:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662400 00000100:00100000:1.0:1769074956.726864:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662400 00000100:00100000:1.0:1769074956.726898:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1769074956.726904:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626662400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1769074956.726922:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1662976 granted 490899520 pending 0 free 3915304960 avail 3683782656 00000100:00100000:1.0:1769074956.726953:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626662400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074956.726959:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1769074956.726983:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626662400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1769074956.727380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074956.727462:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662272 00000100:00100000:3.0:1769074956.727467:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662272 00000100:00100000:3.0:1769074956.727553:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1769074956.727560:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626662272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1769074956.727581:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:3.0:1769074956.727637:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1855007626662272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074956.727642:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1769074956.727696:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1855007626662272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1769074956.728144:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626662016:12345-0@lo:400:kworker.0 Request processed in 2112us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074956.728153:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1769074956.728245:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626662016:0@lo:400:kworker.0 00000100:00100000:0.0:1769074957.013048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.013212:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288768 00000100:00100000:0.0:1769074957.013223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.013223:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288768 00000100:00100000:0.0:1769074957.013242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.013263:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289024 00000100:00100000:0.0:1769074957.013266:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289024 00002000:00100000:0.0:1769074957.013284:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xaf:0x0] (0->157) req@ffff916044f68380 x1855007616289024/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.013284:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xae:0x0] (0->157) req@ffff916044f6a680 x1855007616288768/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.013296:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f68380 with x1855007616289024 ext(0->157) 00002000:00100000:2.0:1769074957.013296:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f6a680 with x1855007616288768 ext(0->157) 00002000:00010000:0.0:1769074957.013303:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f68380 00002000:00010000:2.0:1769074957.013303:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f6a680 00000100:00100000:2.0:1769074957.013321:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289280 00000100:00100000:2.0:1769074957.013375:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289280 00002000:00100000:2.0:1769074957.013392:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb0:0x0] (0->157) req@ffff916044f68e00 x1855007616289280/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.013401:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f68e00 with x1855007616289280 ext(0->157) 00002000:00010000:2.0:1769074957.013404:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f68e00 00000100:00100000:0.0:1769074957.014969:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288640 00000100:00100000:0.0:1769074957.014982:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288640 00002000:00100000:0.0:1769074957.015029:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xad:0x0] (0->157) req@ffff9161815f6d80 x1855007616288640/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015047:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6d80 with x1855007616288640 ext(0->157) 00002000:00010000:0.0:1769074957.015052:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6d80 00000100:00100000:0.0:1769074957.015063:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616288896 00000100:00100000:0.0:1769074957.015066:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616288896 00002000:00100000:0.0:1769074957.015079:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xae:0x0] (0->157) req@ffff9161815f7100 x1855007616288896/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015087:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f7100 with x1855007616288896 ext(0->157) 00002000:00010000:0.0:1769074957.015091:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f7100 00000100:00100000:0.0:1769074957.015097:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289152 00000100:00100000:0.0:1769074957.015100:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289152 00002000:00100000:0.0:1769074957.015110:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xaf:0x0] (0->157) req@ffff9161815f4000 x1855007616289152/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015117:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4000 with x1855007616289152 ext(0->157) 00002000:00010000:0.0:1769074957.015120:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4000 00000100:00100000:0.0:1769074957.015125:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289408 00000100:00100000:0.0:1769074957.015128:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289408 00002000:00100000:0.0:1769074957.015137:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xb0:0x0] (0->157) req@ffff91604b57c380 x1855007616289408/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015144:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c380 with x1855007616289408 ext(0->157) 00002000:00010000:0.0:1769074957.015147:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57c380 00000100:00100000:0.0:1769074957.015152:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289664 00000100:00100000:0.0:1769074957.015154:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289664 00002000:00100000:0.0:1769074957.015162:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xb1:0x0] (0->157) req@ffff91617bbbc450 x1855007616289664/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015168:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617bbbc450 with x1855007616289664 ext(0->157) 00002000:00010000:0.0:1769074957.015172:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617bbbc450 00000100:00100000:0.0:1769074957.015176:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289536 00000100:00100000:0.0:1769074957.015179:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289536 00002000:00100000:0.0:1769074957.015189:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb1:0x0] (0->157) req@ffff91604b57d180 x1855007616289536/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.015196:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d180 with x1855007616289536 ext(0->157) 00002000:00010000:0.0:1769074957.015198:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57d180 00000100:00100000:0.0:1769074957.015209:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 830 00000100:00100000:0.0:1769074957.015218:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+208:2417:x1855007616288768:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.015899:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 831 00000100:00100000:0.0:1769074957.015907:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+210:2417:x1855007616289024:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.016121:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 832 00000100:00100000:0.0:1769074957.016128:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2417:x1855007616289280:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.016800:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 833 00000100:00100000:2.0:1769074957.016812:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+210:2417:x1855007616288640:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.017032:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2417:x1855007616288768:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1812us (3993us total) trans 4294967944 rc 0/0 00000100:00100000:0.0:1769074957.017042:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 830 00002000:00100000:0.0:1769074957.017051:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xae:0x0] (0->157) req@ffff916044f6a680 x1855007616288768/t4294967944(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.017061:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f6a680 with x1855007616288768 ext(0->157) 00002000:00010000:0.0:1769074957.017066:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f6a680 00000100:00100000:0.0:1769074957.017090:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 834 00000100:00100000:0.0:1769074957.017097:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+210:2417:x1855007616288896:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.017735:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 835 00000100:00100000:2.0:1769074957.017744:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+212:2417:x1855007616289152:12345-192.168.204.32@tcp:4:cp.0 00000100:00080000:2.0:1769074957.017960:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1769074957.017966:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074957.018024:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2417:x1855007616288640:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1215us (4882us total) trans 4294967932 rc 0/0 00000100:00100000:2.0:1769074957.018045:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 833 00002000:00100000:2.0:1769074957.018052:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xad:0x0] (0->157) req@ffff9161815f6d80 x1855007616288640/t4294967932(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.018061:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f6d80 with x1855007616288640 ext(0->157) 00002000:00010000:2.0:1769074957.018065:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f6d80 00000100:00100000:2.0:1769074957.018085:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 836 00000100:00100000:2.0:1769074957.018092:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2418:x1855007616289408:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.018287:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 837 00000100:00100000:2.0:1769074957.018294:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2418:x1855007616289664:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.018458:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 838 00000100:00100000:2.0:1769074957.018467:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2418:x1855007616289536:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.018735:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2417:x1855007616289280:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2605us (5621us total) trans 4294967946 rc 0/0 00000100:00100000:2.0:1769074957.018742:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 832 00002000:00100000:2.0:1769074957.018748:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb0:0x0] (0->157) req@ffff916044f68e00 x1855007616289280/t4294967946(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.018756:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f68e00 with x1855007616289280 ext(0->157) 00002000:00010000:2.0:1769074957.018760:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f68e00 00000100:00100000:2.0:1769074957.018801:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+214:2417:x1855007616289024:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2895us (5709us total) trans 4294967945 rc 0/0 00000100:00100000:2.0:1769074957.018807:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 831 00002000:00100000:2.0:1769074957.018812:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xaf:0x0] (0->157) req@ffff916044f68380 x1855007616289024/t4294967945(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.018820:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044f68380 with x1855007616289024 ext(0->157) 00002000:00010000:2.0:1769074957.018823:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044f68380 00000100:00100000:2.0:1769074957.019883:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+217:2418:x1855007616289664:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1585us (6654us total) trans 4294967935 rc 0/0 00000100:00100000:2.0:1769074957.019892:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 837 00002000:00100000:2.0:1769074957.019900:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xb1:0x0] (0->157) req@ffff91617bbbc450 x1855007616289664/t4294967935(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.019909:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617bbbc450 with x1855007616289664 ext(0->157) 00002000:00010000:2.0:1769074957.019914:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617bbbc450 00000100:00100000:2.0:1769074957.019995:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+213:2418:x1855007616289536:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1528us (6750us total) trans 4294967947 rc 0/0 00000100:00100000:2.0:1769074957.020004:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 838 00002000:00100000:2.0:1769074957.020010:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xb1:0x0] (0->157) req@ffff91604b57d180 x1855007616289536/t4294967947(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.020018:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d180 with x1855007616289536 ext(0->157) 00002000:00010000:2.0:1769074957.020021:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57d180 00000100:00100000:2.0:1769074957.020404:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2417:x1855007616289152:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2661us (7218us total) trans 4294967933 rc 0/0 00000100:00100000:2.0:1769074957.020412:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 835 00002000:00100000:2.0:1769074957.020418:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xaf:0x0] (0->157) req@ffff9161815f4000 x1855007616289152/t4294967933(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.020425:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f4000 with x1855007616289152 ext(0->157) 00002000:00010000:2.0:1769074957.020428:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f4000 00000100:00100000:2.0:1769074957.020463:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+215:2418:x1855007616289408:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2372us (7259us total) trans 4294967934 rc 0/0 00000100:00100000:2.0:1769074957.020468:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 836 00002000:00100000:2.0:1769074957.020473:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xb0:0x0] (0->157) req@ffff91604b57c380 x1855007616289408/t4294967934(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.020480:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c380 with x1855007616289408 ext(0->157) 00002000:00010000:2.0:1769074957.020483:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57c380 00000100:00100000:0.0:1769074957.027673:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9161815f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+216:2417:x1855007616288896:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10561us (14497us total) trans 4294967936 rc 0/0 00000100:00100000:0.0:1769074957.027689:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 834 00002000:00100000:0.0:1769074957.027702:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xae:0x0] (0->157) req@ffff9161815f7100 x1855007616288896/t4294967936(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.027714:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9161815f7100 with x1855007616288896 ext(0->157) 00002000:00010000:0.0:1769074957.027720:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9161815f7100 00000100:00100000:2.0:1769074957.029892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.029961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.029980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.029997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.030232:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289920 00000100:00100000:2.0:1769074957.030242:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289920 00002000:00100000:2.0:1769074957.030286:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xb2:0x0] (0->157) req@ffff916044b11180 x1855007616289920/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030297:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11180 with x1855007616289920 ext(0->157) 00002000:00010000:2.0:1769074957.030303:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b11180 00000100:00100000:2.0:1769074957.030321:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290176 00000100:00100000:2.0:1769074957.030324:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290176 00002000:00100000:2.0:1769074957.030336:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xb3:0x0] (0->157) req@ffff916044b13b80 x1855007616290176/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030344:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13b80 with x1855007616290176 ext(0->157) 00002000:00010000:2.0:1769074957.030348:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13b80 00000100:00100000:2.0:1769074957.030354:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616289792 00000100:00100000:2.0:1769074957.030356:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616289792 00002000:00100000:2.0:1769074957.030368:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb2:0x0] (0->157) req@ffff916044b12300 x1855007616289792/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030376:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12300 with x1855007616289792 ext(0->157) 00002000:00010000:2.0:1769074957.030379:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12300 00000100:00100000:2.0:1769074957.030384:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290048 00000100:00100000:2.0:1769074957.030386:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290048 00002000:00100000:2.0:1769074957.030395:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb3:0x0] (0->157) req@ffff916044b12680 x1855007616290048/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030402:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12680 with x1855007616290048 ext(0->157) 00002000:00010000:2.0:1769074957.030406:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12680 00000100:00100000:2.0:1769074957.030411:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290304 00000100:00100000:2.0:1769074957.030413:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290304 00002000:00100000:2.0:1769074957.030422:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb4:0x0] (0->157) req@ffff916044b11500 x1855007616290304/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030429:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11500 with x1855007616290304 ext(0->157) 00002000:00010000:2.0:1769074957.030431:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b11500 00000100:00100000:2.0:1769074957.030436:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290560 00000100:00100000:2.0:1769074957.030438:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290560 00002000:00100000:2.0:1769074957.030447:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb5:0x0] (0->157) req@ffff916044b10700 x1855007616290560/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030454:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b10700 with x1855007616290560 ext(0->157) 00002000:00010000:2.0:1769074957.030457:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b10700 00000100:00100000:2.0:1769074957.030462:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290816 00000100:00100000:2.0:1769074957.030464:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290816 00002000:00100000:2.0:1769074957.030473:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb6:0x0] (0->157) req@ffff916044b13100 x1855007616290816/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030480:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13100 with x1855007616290816 ext(0->157) 00002000:00010000:2.0:1769074957.030483:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13100 00000100:00100000:2.0:1769074957.030487:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290432 00000100:00100000:2.0:1769074957.030489:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290432 00002000:00100000:2.0:1769074957.030498:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xb4:0x0] (0->157) req@ffff916044b12a00 x1855007616290432/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030505:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12a00 with x1855007616290432 ext(0->157) 00002000:00010000:2.0:1769074957.030508:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b12a00 00000100:00100000:2.0:1769074957.030512:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290688 00000100:00100000:2.0:1769074957.030515:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290688 00002000:00100000:2.0:1769074957.030526:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xb5:0x0] (0->157) req@ffff916044b13800 x1855007616290688/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.030562:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13800 with x1855007616290688 ext(0->157) 00002000:00010000:2.0:1769074957.030565:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13800 00000100:00100000:2.0:1769074957.030576:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 839 00000100:00100000:2.0:1769074957.030584:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+219:2418:x1855007616289920:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.031007:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 840 00000100:00100000:2.0:1769074957.031015:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+221:2418:x1855007616290176:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.031404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.031422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.031437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.031474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.031491:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616290944 00000100:00100000:3.0:1769074957.031497:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616290944 00002000:00100000:3.0:1769074957.031524:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (0->157) req@ffff91604b0f8380 x1855007616290944/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.031553:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8380 with x1855007616290944 ext(0->157) 00002000:00010000:3.0:1769074957.031558:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0f8380 00000100:00100000:3.0:1769074957.031567:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291072 00000100:00100000:3.0:1769074957.031570:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291072 00002000:00100000:3.0:1769074957.031584:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc7:0x0] (0->157) req@ffff91604b0f8a80 x1855007616291072/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.031592:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8a80 with x1855007616291072 ext(0->157) 00002000:00010000:3.0:1769074957.031595:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f8a80 00000100:00100000:3.0:1769074957.031602:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291328 00000100:00100000:3.0:1769074957.031604:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291328 00002000:00100000:3.0:1769074957.031627:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc8:0x0] (0->157) req@ffff91604b0f9c00 x1855007616291328/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.031635:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f9c00 with x1855007616291328 ext(0->157) 00002000:00010000:3.0:1769074957.031639:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f9c00 00000100:00100000:3.0:1769074957.031646:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291200 00000100:00100000:3.0:1769074957.031649:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291200 00002000:00100000:3.0:1769074957.031661:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xbf:0x0] (0->157) req@ffff91604b0fad80 x1855007616291200/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.031668:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fad80 with x1855007616291200 ext(0->157) 00002000:00010000:3.0:1769074957.031672:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0fad80 00000100:00100000:3.0:1769074957.031679:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 841 00000100:00100000:3.0:1769074957.031685:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+220:2418:x1855007616289792:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.031971:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 842 00000100:00100000:3.0:1769074957.031979:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2418:x1855007616290048:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.034013:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 843 00000100:00100000:1.0:1769074957.034031:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+222:2417:x1855007616290304:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.034291:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 844 00000100:00100000:2.0:1769074957.034454:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2417:x1855007616290560:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.040566:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 845 00000100:00100000:1.0:1769074957.040589:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2417:x1855007616290816:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.041112:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2417:x1855007616290304:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7085us (11089us total) trans 4294967949 rc 0/0 00000100:00100000:1.0:1769074957.041123:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 843 00002000:00100000:1.0:1769074957.041132:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb4:0x0] (0->157) req@ffff916044b11500 x1855007616290304/t4294967949(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.041143:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11500 with x1855007616290304 ext(0->157) 00002000:00010000:1.0:1769074957.041150:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b11500 00000100:00100000:1.0:1769074957.041182:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 846 00000100:00100000:1.0:1769074957.041190:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+224:2417:x1855007616290432:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.041496:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2417:x1855007616290560:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7045us (11346us total) trans 4294967951 rc 0/0 00000100:00100000:1.0:1769074957.041504:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 844 00002000:00100000:1.0:1769074957.041510:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xb5:0x0] (0->157) req@ffff916044b10700 x1855007616290560/t4294967951(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.041519:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b10700 with x1855007616290560 ext(0->157) 00002000:00010000:1.0:1769074957.041523:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b10700 00000100:00100000:1.0:1769074957.041568:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 847 00000100:00100000:1.0:1769074957.041575:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+226:2417:x1855007616290688:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.041791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.041942:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2418:x1855007616290176:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10927us (11979us total) trans 4294967938 rc 0/0 00000100:00100000:1.0:1769074957.041950:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 840 00002000:00100000:1.0:1769074957.041957:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xb3:0x0] (0->157) req@ffff916044b13b80 x1855007616290176/t4294967938(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.041966:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13b80 with x1855007616290176 ext(0->157) 00002000:00010000:1.0:1769074957.041970:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13b80 00000100:00100000:1.0:1769074957.041986:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 848 00000100:00100000:1.0:1769074957.041993:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+227:2417:x1855007616290944:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.042199:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+229:2418:x1855007616289920:12345-192.168.204.32@tcp:4:cp.0 Request processed in 11614us (12315us total) trans 4294967937 rc 0/0 00000100:00100000:1.0:1769074957.042207:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 839 00002000:00100000:1.0:1769074957.042213:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xb2:0x0] (0->157) req@ffff916044b11180 x1855007616289920/t4294967937(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.042222:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b11180 with x1855007616289920 ext(0->157) 00002000:00010000:1.0:1769074957.042225:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b11180 00000100:00100000:1.0:1769074957.042245:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 849 00000100:00100000:1.0:1769074957.042252:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+228:2417:x1855007616291072:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.042466:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 850 00000100:00100000:1.0:1769074957.042474:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2417:x1855007616291328:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.043763:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 851 00000100:00100000:3.0:1769074957.043784:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2417:x1855007616291200:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.044897:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2417:x1855007616291200:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1118us (13417us total) trans 4294967955 rc 0/0 00000100:00100000:3.0:1769074957.044908:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 851 00002000:00100000:3.0:1769074957.044918:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xbf:0x0] (0->157) req@ffff91604b0fad80 x1855007616291200/t4294967955(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.044927:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fad80 with x1855007616291200 ext(0->157) 00002000:00010000:3.0:1769074957.044932:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0fad80 00000100:00100000:3.0:1769074957.044993:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2418:x1855007616290048:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13014us (14995us total) trans 4294967950 rc 0/0 00000100:00100000:3.0:1769074957.045001:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 842 00002000:00100000:3.0:1769074957.045007:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xb3:0x0] (0->157) req@ffff916044b12680 x1855007616290048/t4294967950(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.045022:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12680 with x1855007616290048 ext(0->157) 00002000:00010000:3.0:1769074957.045026:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12680 00000100:00100000:3.0:1769074957.045101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.045155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.045232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.045249:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291840 00000100:00100000:3.0:1769074957.045256:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291840 00002000:00100000:3.0:1769074957.045287:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (0->157) req@ffff91604b0fb100 x1855007616291840/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.045295:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fb100 with x1855007616291840 ext(0->157) 00002000:00010000:3.0:1769074957.045299:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fb100 00000100:00100000:3.0:1769074957.045310:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292096 00000100:00100000:3.0:1769074957.045312:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292096 00002000:00100000:3.0:1769074957.045334:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xbc:0x0] (0->157) req@ffff91604b0fa300 x1855007616292096/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.045342:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fa300 with x1855007616292096 ext(0->157) 00002000:00010000:3.0:1769074957.045346:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fa300 00000100:00100000:3.0:1769074957.045353:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291712 00000100:00100000:3.0:1769074957.045356:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291712 00002000:00100000:3.0:1769074957.045370:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc3:0x0] (0->157) req@ffff91604b0faa00 x1855007616291712/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.045378:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0faa00 with x1855007616291712 ext(0->157) 00002000:00010000:3.0:1769074957.045382:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0faa00 00000100:00100000:3.0:1769074957.045392:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 852 00000100:00100000:3.0:1769074957.045400:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2418:x1855007616291840:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.045741:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 853 00000100:00100000:3.0:1769074957.045749:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2418:x1855007616292096:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.045963:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2418:x1855007616289792:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14277us (15981us total) trans 4294967948 rc 0/0 00000100:00100000:3.0:1769074957.045971:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 841 00002000:00100000:3.0:1769074957.045977:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb2:0x0] (0->157) req@ffff916044b12300 x1855007616289792/t4294967948(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.045984:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12300 with x1855007616289792 ext(0->157) 00002000:00010000:3.0:1769074957.045988:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b12300 00000100:00100000:3.0:1769074957.046029:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 854 00000100:00100000:3.0:1769074957.046035:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2418:x1855007616291712:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.046243:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291456 00000100:00100000:3.0:1769074957.046248:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291456 00000100:00100000:3.0:1769074957.046278:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2908 00000100:00100000:3.0:1769074957.046286:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2418:x1855007616291456:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:3.0:1769074957.046333:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+235:2418:x1855007616291456:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 48us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074957.046340:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2908 00000100:00100000:1.0:1769074957.048645:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2417:x1855007616290432:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7444us (18444us total) trans 4294967939 rc 0/0 00000100:00100000:1.0:1769074957.048661:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 846 00002000:00100000:1.0:1769074957.048675:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xb4:0x0] (0->157) req@ffff916044b12a00 x1855007616290432/t4294967939(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.048684:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b12a00 with x1855007616290432 ext(0->157) 00002000:00010000:1.0:1769074957.048690:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b12a00 00000100:00100000:1.0:1769074957.048760:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616290688:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7185us (18550us total) trans 4294967940 rc 0/0 00000100:00100000:1.0:1769074957.048767:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 847 00002000:00100000:1.0:1769074957.049518:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xb5:0x0] (0->157) req@ffff916044b13800 x1855007616290688/t4294967940(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.049545:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13800 with x1855007616290688 ext(0->157) 00002000:00010000:1.0:1769074957.049551:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916044b13800 00000100:00100000:1.0:1769074957.049631:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+234:2417:x1855007616291328:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7157us (18192us total) trans 4294967954 rc 0/0 00000100:00100000:1.0:1769074957.049640:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 850 00002000:00100000:1.0:1769074957.049647:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xc8:0x0] (0->157) req@ffff91604b0f9c00 x1855007616291328/t4294967954(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.049654:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f9c00 with x1855007616291328 ext(0->157) 00002000:00010000:1.0:1769074957.049658:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f9c00 00000100:00100000:1.0:1769074957.049703:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2417:x1855007616290944:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7710us (18300us total) trans 4294967941 rc 0/0 00000100:00100000:1.0:1769074957.049710:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 848 00002000:00100000:1.0:1769074957.049716:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (0->157) req@ffff91604b0f8380 x1855007616290944/t4294967941(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.049723:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8380 with x1855007616290944 ext(0->157) 00002000:00010000:1.0:1769074957.049727:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0f8380 00000100:00100000:1.0:1769074957.049767:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616291072:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7515us (18343us total) trans 4294967953 rc 0/0 00000100:00100000:1.0:1769074957.051216:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 849 00002000:00100000:1.0:1769074957.051230:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xc7:0x0] (0->157) req@ffff91604b0f8a80 x1855007616291072/t4294967953(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.051238:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8a80 with x1855007616291072 ext(0->157) 00002000:00010000:1.0:1769074957.051243:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f8a80 00000100:00100000:1.0:1769074957.051572:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+232:2417:x1855007616290816:12345-192.168.204.32@tcp:4:cp.0 Request processed in 10990us (21398us total) trans 4294967952 rc 0/0 00000100:00100000:3.0:1769074957.051572:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+231:2418:x1855007616291840:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6171us (6469us total) trans 4294967942 rc 0/0 00000100:00100000:1.0:1769074957.051579:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 845 00002000:00100000:1.0:1769074957.051586:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb6:0x0] (0->157) req@ffff916044b13100 x1855007616290816/t4294967952(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1769074957.051587:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 852 00002000:00100000:3.0:1769074957.051592:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (0->157) req@ffff91604b0fb100 x1855007616291840/t4294967942(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.051595:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13100 with x1855007616290816 ext(0->157) 00002000:00010000:1.0:1769074957.051599:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13100 00002000:00100000:3.0:1769074957.051606:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fb100 with x1855007616291840 ext(0->157) 00002000:00010000:3.0:1769074957.051609:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fb100 00000100:00100000:3.0:1769074957.051663:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+230:2418:x1855007616292096:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5914us (6506us total) trans 4294967943 rc 0/0 00000100:00100000:3.0:1769074957.051669:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 853 00002000:00100000:3.0:1769074957.051675:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xbc:0x0] (0->157) req@ffff91604b0fa300 x1855007616292096/t4294967943(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.051683:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fa300 with x1855007616292096 ext(0->157) 00002000:00010000:3.0:1769074957.051687:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fa300 00000100:00100000:2.0:1769074957.052435:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+231:2418:x1855007616291712:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6396us (7199us total) trans 4294967956 rc 0/0 00000100:00100000:2.0:1769074957.052445:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 854 00002000:00100000:2.0:1769074957.052451:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc3:0x0] (0->157) req@ffff91604b0faa00 x1855007616291712/t4294967956(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.052458:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0faa00 with x1855007616291712 ext(0->157) 00002000:00010000:2.0:1769074957.052462:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0faa00 00000100:00100000:3.0:1769074957.052891:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.052929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.052946:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.052966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.052983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.052999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.053016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.053290:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291584 00000100:00100000:1.0:1769074957.053299:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291584 00002000:00100000:1.0:1769074957.053339:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xce:0x0] (0->157) req@ffff91604b0fb480 x1855007616291584/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053348:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fb480 with x1855007616291584 ext(0->157) 00002000:00010000:1.0:1769074957.053353:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fb480 00000100:00100000:1.0:1769074957.053372:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616291968 00000100:00100000:1.0:1769074957.053375:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616291968 00002000:00100000:1.0:1769074957.053389:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcf:0x0] (0->157) req@ffff91604b0fbb80 x1855007616291968/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053397:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fbb80 with x1855007616291968 ext(0->157) 00002000:00010000:1.0:1769074957.053400:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fbb80 00000100:00100000:1.0:1769074957.053414:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292224 00000100:00100000:1.0:1769074957.053417:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292224 00002000:00100000:1.0:1769074957.053431:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xbd:0x0] (0->157) req@ffff91604b0f8700 x1855007616292224/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053439:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8700 with x1855007616292224 ext(0->157) 00002000:00010000:1.0:1769074957.053443:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f8700 00000100:00100000:1.0:1769074957.053453:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292352 00000100:00100000:1.0:1769074957.053456:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292352 00002000:00100000:1.0:1769074957.053466:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->157) req@ffff91604ac91500 x1855007616292352/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053473:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91500 with x1855007616292352 ext(0->157) 00002000:00010000:1.0:1769074957.053477:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91500 00000100:00100000:1.0:1769074957.053483:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292480 00000100:00100000:1.0:1769074957.053485:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292480 00002000:00100000:1.0:1769074957.053495:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd1:0x0] (0->157) req@ffff91604ac92d80 x1855007616292480/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053502:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92d80 with x1855007616292480 ext(0->157) 00002000:00010000:1.0:1769074957.053505:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92d80 00000100:00100000:1.0:1769074957.053509:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292608 00000100:00100000:1.0:1769074957.053511:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292608 00002000:00100000:1.0:1769074957.053519:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xb9:0x0] (0->157) req@ffff91604ac93800 x1855007616292608/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053526:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac93800 with x1855007616292608 ext(0->157) 00002000:00010000:1.0:1769074957.053547:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac93800 00000100:00100000:1.0:1769074957.053553:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292736 00000100:00100000:1.0:1769074957.053556:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292736 00002000:00100000:1.0:1769074957.053566:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xba:0x0] (0->157) req@ffff91604ac92300 x1855007616292736/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.053573:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92300 with x1855007616292736 ext(0->157) 00002000:00010000:1.0:1769074957.053575:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92300 00000100:00100000:1.0:1769074957.053583:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 855 00000100:00100000:1.0:1769074957.053590:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616291584:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.053917:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 856 00000100:00100000:0.0:1769074957.053929:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616291968:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.054008:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 857 00000100:00100000:1.0:1769074957.054015:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616292224:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.054124:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 858 00000100:00100000:0.0:1769074957.054132:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+233:2417:x1855007616292352:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.055429:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 859 00000100:00100000:0.0:1769074957.055443:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2418:x1855007616292480:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.055817:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2417:x1855007616292352:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1683us (2847us total) trans 4294967957 rc 0/0 00000100:00100000:1.0:1769074957.056673:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 860 00000100:00100000:1.0:1769074957.056687:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2418:x1855007616292608:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.057810:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+237:2417:x1855007616292224:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3789us (4857us total) trans 4294967958 rc 0/0 00000100:00100000:1.0:1769074957.057821:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 857 00002000:00100000:1.0:1769074957.057832:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xbd:0x0] (0->157) req@ffff91604b0f8700 x1855007616292224/t4294967958(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.057842:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0f8700 with x1855007616292224 ext(0->157) 00002000:00010000:1.0:1769074957.057848:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b0f8700 00000100:00100000:1.0:1769074957.057877:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 861 00000100:00100000:1.0:1769074957.057885:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+236:2418:x1855007616292736:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.059527:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2418:x1855007616292608:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2834us (6515us total) trans 4294967947 rc 0/0 00000100:00100000:1.0:1769074957.059554:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 860 00002000:00100000:1.0:1769074957.059564:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xb9:0x0] (0->157) req@ffff91604ac93800 x1855007616292608/t4294967947(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.059574:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac93800 with x1855007616292608 ext(0->157) 00002000:00010000:1.0:1769074957.059579:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac93800 00000100:00100000:1.0:1769074957.059639:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2417:x1855007616291584:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6048us (6749us total) trans 4294967944 rc 0/0 00000100:00100000:1.0:1769074957.059646:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 855 00002000:00100000:1.0:1769074957.059652:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xce:0x0] (0->157) req@ffff91604b0fb480 x1855007616291584/t4294967944(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.059659:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fb480 with x1855007616291584 ext(0->157) 00002000:00010000:1.0:1769074957.059663:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fb480 00000100:00100000:1.0:1769074957.059724:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b0fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+239:2417:x1855007616291968:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5799us (6794us total) trans 4294967945 rc 0/0 00000100:00100000:1.0:1769074957.059731:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 856 00002000:00100000:1.0:1769074957.059736:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcf:0x0] (0->157) req@ffff91604b0fbb80 x1855007616291968/t4294967945(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.059744:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b0fbb80 with x1855007616291968 ext(0->157) 00002000:00010000:1.0:1769074957.059748:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b0fbb80 00000100:00100000:1.0:1769074957.059809:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616292480:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4370us (6824us total) trans 4294967946 rc 0/0 00000100:00100000:1.0:1769074957.059816:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 859 00002000:00100000:1.0:1769074957.059822:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xd1:0x0] (0->157) req@ffff91604ac92d80 x1855007616292480/t4294967946(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.059829:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92d80 with x1855007616292480 ext(0->157) 00002000:00010000:1.0:1769074957.059833:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac92d80 00000100:00100000:1.0:1769074957.065318:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616292736:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7423us (12289us total) trans 4294967959 rc 0/0 00000100:00100000:1.0:1769074957.065334:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 861 00002000:00100000:1.0:1769074957.065350:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xba:0x0] (0->157) req@ffff91604ac92300 x1855007616292736/t4294967959(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.065361:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92300 with x1855007616292736 ext(0->157) 00002000:00010000:1.0:1769074957.065369:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92300 00000100:00100000:2.0:1769074957.065607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.065690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.065887:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292864 00000100:00100000:1.0:1769074957.065896:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292864 00002000:00100000:1.0:1769074957.065937:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc5:0x0] (0->157) req@ffff916044b13480 x1855007616292864/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.065946:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13480 with x1855007616292864 ext(0->157) 00002000:00010000:1.0:1769074957.065951:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13480 00000100:00100000:1.0:1769074957.065972:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 862 00000100:00100000:1.0:1769074957.065981:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+238:2418:x1855007616292864:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.066913:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2418:x1855007616292864:12345-192.168.204.32@tcp:4:cp.0 Request processed in 930us (1305us total) trans 4294967960 rc 0/0 00000100:00100000:1.0:1769074957.066923:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 862 00002000:00100000:1.0:1769074957.066931:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc5:0x0] (0->157) req@ffff916044b13480 x1855007616292864/t4294967960(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.066940:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916044b13480 with x1855007616292864 ext(0->157) 00002000:00010000:1.0:1769074957.066944:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916044b13480 00000100:00100000:2.0:1769074957.067572:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616292992 00000100:00100000:2.0:1769074957.067581:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616292992 00000100:00100000:2.0:1769074957.067630:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2909 00000100:00100000:2.0:1769074957.067638:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2419:x1855007616292992:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:2.0:1769074957.067711:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2419:x1855007616292992:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 74us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074957.067719:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2909 00000100:00100000:1.0:1769074957.068563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.068645:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293120 00000100:00100000:3.0:1769074957.068652:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293120 00002000:00100000:3.0:1769074957.068683:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd5:0x0] (0->157) req@ffff916049eb4000 x1855007616293120/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.068693:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4000 with x1855007616293120 ext(0->157) 00002000:00010000:3.0:1769074957.068698:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb4000 00000100:00100000:3.0:1769074957.068725:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 863 00000100:00100000:3.0:1769074957.068731:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+240:2418:x1855007616293120:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.070924:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 858 00002000:00100000:0.0:1769074957.070943:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xc4:0x0] (0->157) req@ffff91604ac91500 x1855007616292352/t4294967957(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.070956:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91500 with x1855007616292352 ext(0->157) 00002000:00010000:0.0:1769074957.070962:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91500 00000100:00100000:0.0:1769074957.076242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.076319:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293376 00000100:00100000:1.0:1769074957.076342:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293376 00002000:00100000:1.0:1769074957.076389:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xd7:0x0] (0->157) req@ffff91604b57d880 x1855007616293376/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.076401:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d880 with x1855007616293376 ext(0->157) 00002000:00010000:1.0:1769074957.076406:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57d880 00000100:00100000:1.0:1769074957.076434:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 864 00000100:00100000:1.0:1769074957.076444:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2418:x1855007616293376:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.076586:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+242:2418:x1855007616293120:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7852us (8023us total) trans 4294967961 rc 0/0 00000100:00100000:2.0:1769074957.076595:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 863 00002000:00100000:2.0:1769074957.076603:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd5:0x0] (0->157) req@ffff916049eb4000 x1855007616293120/t4294967961(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.076610:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4000 with x1855007616293120 ext(0->157) 00002000:00010000:2.0:1769074957.076624:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb4000 00000100:00100000:1.0:1769074957.077546:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2418:x1855007616293376:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1085us (1294us total) trans 4294967962 rc 0/0 00000100:00100000:1.0:1769074957.077555:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 864 00002000:00100000:1.0:1769074957.077562:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xd7:0x0] (0->157) req@ffff91604b57d880 x1855007616293376/t4294967962(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.077572:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d880 with x1855007616293376 ext(0->157) 00002000:00010000:1.0:1769074957.077575:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57d880 00000100:00100000:0.0:1769074957.081255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.081686:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293632 00000100:00100000:0.0:1769074957.081696:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293632 00002000:00100000:0.0:1769074957.081743:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xbd:0x0] (0->157) req@ffff91604b57ce00 x1855007616293632/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.081755:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57ce00 with x1855007616293632 ext(0->157) 00002000:00010000:0.0:1769074957.081761:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57ce00 00000100:00100000:0.0:1769074957.081860:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293888 00000100:00100000:0.0:1769074957.081864:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293888 00002000:00100000:0.0:1769074957.081883:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xd8:0x0] (0->157) req@ffff91604b57c000 x1855007616293888/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.081891:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c000 with x1855007616293888 ext(0->157) 00002000:00010000:0.0:1769074957.081895:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57c000 00000100:00100000:0.0:1769074957.081907:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293248 00000100:00100000:0.0:1769074957.081910:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293248 00002000:00100000:0.0:1769074957.081925:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xd6:0x0] (0->157) req@ffff91604b57c380 x1855007616293248/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.081933:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c380 with x1855007616293248 ext(0->157) 00002000:00010000:0.0:1769074957.081936:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57c380 00000100:00100000:0.0:1769074957.081948:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293504 00000100:00100000:0.0:1769074957.081951:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293504 00002000:00100000:0.0:1769074957.081965:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xc4:0x0] (0->157) req@ffff91604b57dc00 x1855007616293504/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.081971:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57dc00 with x1855007616293504 ext(0->157) 00002000:00010000:0.0:1769074957.081975:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57dc00 00000100:00100000:0.0:1769074957.081988:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616293760 00000100:00100000:0.0:1769074957.081990:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616293760 00002000:00100000:0.0:1769074957.082003:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xc5:0x0] (0->157) req@ffff91604b57d500 x1855007616293760/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.082011:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d500 with x1855007616293760 ext(0->157) 00002000:00010000:0.0:1769074957.082014:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57d500 00000100:00100000:0.0:1769074957.082025:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294016 00000100:00100000:0.0:1769074957.082028:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294016 00002000:00100000:0.0:1769074957.082043:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xb6:0x0] (0->157) req@ffff91604b57ca80 x1855007616294016/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.082050:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57ca80 with x1855007616294016 ext(0->157) 00002000:00010000:0.0:1769074957.082054:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57ca80 00000100:00100000:0.0:1769074957.082067:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 865 00000100:00100000:0.0:1769074957.082075:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+241:2418:x1855007616293632:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.082237:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 866 00000100:00100000:1.0:1769074957.082247:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+244:2418:x1855007616293888:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.082521:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 867 00000100:00100000:1.0:1769074957.082552:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2417:x1855007616293248:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.082669:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 868 00000100:00100000:0.0:1769074957.082676:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2417:x1855007616293504:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.082724:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 869 00000100:00100000:1.0:1769074957.082731:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+243:2417:x1855007616293760:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.082912:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 870 00000100:00100000:1.0:1769074957.082919:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+245:2417:x1855007616294016:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.083881:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2418:x1855007616293888:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1632us (2591us total) trans 4294967963 rc 0/0 00000100:00100000:1.0:1769074957.083892:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 866 00002000:00100000:1.0:1769074957.083901:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xd8:0x0] (0->157) req@ffff91604b57c000 x1855007616293888/t4294967963(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.083911:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c000 with x1855007616293888 ext(0->157) 00002000:00010000:1.0:1769074957.083916:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57c000 00000100:00100000:1.0:1769074957.083965:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2417:x1855007616293248:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1437us (2657us total) trans 4294967964 rc 0/0 00000100:00100000:1.0:1769074957.083972:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 867 00002000:00100000:1.0:1769074957.083977:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xd6:0x0] (0->157) req@ffff91604b57c380 x1855007616293248/t4294967964(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.083985:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57c380 with x1855007616293248 ext(0->157) 00002000:00010000:1.0:1769074957.083989:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57c380 00000100:00100000:1.0:1769074957.084028:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+249:2417:x1855007616294016:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1109us (2378us total) trans 4294967950 rc 0/0 00000100:00100000:1.0:1769074957.084048:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 870 00002000:00100000:1.0:1769074957.084054:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xb6:0x0] (0->157) req@ffff91604b57ca80 x1855007616294016/t4294967950(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.084061:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57ca80 with x1855007616294016 ext(0->157) 00002000:00010000:1.0:1769074957.084065:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57ca80 00000100:00100000:1.0:1769074957.084103:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+248:2417:x1855007616293760:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1371us (2509us total) trans 4294967949 rc 0/0 00000100:00100000:1.0:1769074957.084109:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 869 00002000:00100000:1.0:1769074957.084114:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xc5:0x0] (0->157) req@ffff91604b57d500 x1855007616293760/t4294967949(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.084122:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57d500 with x1855007616293760 ext(0->157) 00002000:00010000:1.0:1769074957.084125:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57d500 00000100:00100000:0.0:1769074957.087185:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+247:2418:x1855007616293632:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5096us (5924us total) trans 4294967948 rc 0/0 00000100:00100000:0.0:1769074957.087200:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 865 00002000:00100000:0.0:1769074957.087213:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xbd:0x0] (0->157) req@ffff91604b57ce00 x1855007616293632/t4294967948(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.087224:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57ce00 with x1855007616293632 ext(0->157) 00002000:00010000:0.0:1769074957.087230:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57ce00 00000100:00100000:1.0:1769074957.091319:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+246:2417:x1855007616293504:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8628us (9732us total) trans 4294967951 rc 0/0 00000100:00100000:1.0:1769074957.091335:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 868 00002000:00100000:1.0:1769074957.091351:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc4:0x0] (0->157) req@ffff91604b57dc00 x1855007616293504/t4294967951(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.091363:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57dc00 with x1855007616293504 ext(0->157) 00002000:00010000:1.0:1769074957.091370:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57dc00 00000100:00100000:1.0:1769074957.098479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098519:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098592:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.098822:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294144 00000100:00100000:1.0:1769074957.098833:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294144 00002000:00100000:1.0:1769074957.098886:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd6:0x0] (0->157) req@ffff916049eb5880 x1855007616294144/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.098897:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb5880 with x1855007616294144 ext(0->157) 00002000:00010000:1.0:1769074957.098903:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb5880 00000100:00100000:1.0:1769074957.098919:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294400 00000100:00100000:1.0:1769074957.098922:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294400 00002000:00100000:1.0:1769074957.098936:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd7:0x0] (0->157) req@ffff916049eb6a00 x1855007616294400/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.098943:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6a00 with x1855007616294400 ext(0->157) 00002000:00010000:1.0:1769074957.098947:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6a00 00000100:00100000:1.0:1769074957.098952:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294272 00000100:00100000:1.0:1769074957.098955:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294272 00002000:00100000:1.0:1769074957.098965:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xbe:0x0] (0->157) req@ffff916049eb6d80 x1855007616294272/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.098973:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6d80 with x1855007616294272 ext(0->157) 00002000:00010000:1.0:1769074957.098977:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6d80 00000100:00100000:1.0:1769074957.098982:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294528 00000100:00100000:1.0:1769074957.098984:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294528 00002000:00100000:1.0:1769074957.098996:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xc7:0x0] (0->157) req@ffff916049eb4a80 x1855007616294528/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.099003:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4a80 with x1855007616294528 ext(0->157) 00002000:00010000:1.0:1769074957.099007:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb4a80 00000100:00100000:1.0:1769074957.099013:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294656 00000100:00100000:1.0:1769074957.099016:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294656 00002000:00100000:1.0:1769074957.099027:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd8:0x0] (0->157) req@ffff916049eb6680 x1855007616294656/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1769074957.099440:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294784 00000100:00100000:2.0:1769074957.099446:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294784 00002000:00100000:2.0:1769074957.099470:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xd9:0x0] (0->157) req@ffff916049eb7100 x1855007616294784/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099479:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb7100 with x1855007616294784 ext(0->157) 00002000:00010000:2.0:1769074957.099483:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb7100 00000100:00100000:2.0:1769074957.099492:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616294912 00000100:00100000:2.0:1769074957.099494:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616294912 00002000:00100000:2.0:1769074957.099506:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xc0:0x0] (0->157) req@ffff916049eb5180 x1855007616294912/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099514:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb5180 with x1855007616294912 ext(0->157) 00002000:00010000:2.0:1769074957.099518:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb5180 00000100:00100000:2.0:1769074957.099525:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295168 00000100:00100000:2.0:1769074957.099527:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295168 00002000:00100000:2.0:1769074957.099558:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xca:0x0] (0->157) req@ffff916049eb7b80 x1855007616295168/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099567:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb7b80 with x1855007616295168 ext(0->157) 00002000:00010000:2.0:1769074957.099571:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb7b80 00000100:00100000:2.0:1769074957.099578:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295296 00000100:00100000:2.0:1769074957.099580:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295296 00002000:00100000:2.0:1769074957.099593:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xdb:0x0] (0->157) req@ffff916049eb4e00 x1855007616295296/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099600:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4e00 with x1855007616295296 ext(0->157) 00002000:00010000:2.0:1769074957.099603:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb4e00 00000100:00100000:2.0:1769074957.099609:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295040 00000100:00100000:2.0:1769074957.099611:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295040 00002000:00100000:2.0:1769074957.099636:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xda:0x0] (0->157) req@ffff9160434b0380 x1855007616295040/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099643:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0380 with x1855007616295040 ext(0->157) 00002000:00010000:2.0:1769074957.099647:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0380 00000100:00100000:2.0:1769074957.099653:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295680 00000100:00100000:2.0:1769074957.099655:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295680 00002000:00100000:2.0:1769074957.099666:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xdc:0x0] (0->157) req@ffff9160434b0000 x1855007616295680/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099673:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0000 with x1855007616295680 ext(0->157) 00002000:00010000:2.0:1769074957.099676:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0000 00000100:00100000:2.0:1769074957.099682:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295936 00000100:00100000:2.0:1769074957.099685:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295936 00002000:00100000:2.0:1769074957.099696:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xdc:0x0] (0->157) req@ffff9160434b2680 x1855007616295936/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099703:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b2680 with x1855007616295936 ext(0->157) 00002000:00010000:2.0:1769074957.099707:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b2680 00000100:00100000:2.0:1769074957.099712:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295552 00000100:00100000:2.0:1769074957.099715:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295552 00002000:00100000:2.0:1769074957.099725:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xda:0x0] (0->157) req@ffff9160434b1c00 x1855007616295552/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099732:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1c00 with x1855007616295552 ext(0->157) 00002000:00010000:2.0:1769074957.099736:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b1c00 00000100:00100000:2.0:1769074957.099742:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295808 00000100:00100000:2.0:1769074957.099744:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295808 00002000:00100000:2.0:1769074957.099757:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xdb:0x0] (0->157) req@ffff9160434b3800 x1855007616295808/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.099764:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b3800 with x1855007616295808 ext(0->157) 00002000:00010000:2.0:1769074957.099767:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b3800 00000100:00100000:2.0:1769074957.099855:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 871 00000100:00100000:2.0:1769074957.099865:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+253:2417:x1855007616294144:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.100141:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 872 00000100:00100000:0.0:1769074957.100152:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+253:2418:x1855007616294400:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.100466:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 873 00000100:00100000:0.0:1769074957.100474:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+255:2418:x1855007616294272:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.100669:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 874 00000100:00100000:0.0:1769074957.100675:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+257:2417:x1855007616294528:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.100856:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 875 00000100:00100000:0.0:1769074957.100864:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+252:2417:x1855007616294784:12345-192.168.204.32@tcp:4:cp.0 00002000:00100000:1.0:1769074957.101896:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6680 with x1855007616294656 ext(0->157) 00002000:00010000:1.0:1769074957.101902:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6680 00000100:00100000:1.0:1769074957.101930:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 876 00000100:00100000:1.0:1769074957.101941:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+252:2418:x1855007616294912:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.102455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.102473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.102485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.102495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.102512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.102549:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616295424 00000100:00100000:3.0:1769074957.102556:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616295424 00000100:00100000:3.0:1769074957.102585:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2910 00000100:00100000:3.0:1769074957.102591:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2420:x1855007616295424:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:3.0:1769074957.102669:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2420:x1855007616295424:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074957.102676:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2910 00000100:00100000:3.0:1769074957.102696:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296064 00000100:00100000:3.0:1769074957.102698:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296064 00002000:00100000:3.0:1769074957.102717:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xdd:0x0] (0->157) req@ffff91604ac91880 x1855007616296064/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.102725:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91880 with x1855007616296064 ext(0->157) 00002000:00010000:3.0:1769074957.102729:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91880 00000100:00100000:3.0:1769074957.102736:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296320 00000100:00100000:3.0:1769074957.102738:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296320 00002000:00100000:3.0:1769074957.102747:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xde:0x0] (0->157) req@ffff91604ac92a00 x1855007616296320/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.102754:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92a00 with x1855007616296320 ext(0->157) 00002000:00010000:3.0:1769074957.102758:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92a00 00000100:00100000:3.0:1769074957.102762:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296192 00000100:00100000:3.0:1769074957.102764:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296192 00002000:00100000:3.0:1769074957.102772:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xc1:0x0] (0->157) req@ffff91604ac91c00 x1855007616296192/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.102789:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91c00 with x1855007616296192 ext(0->157) 00002000:00010000:3.0:1769074957.102793:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91c00 00000100:00100000:3.0:1769074957.102800:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296448 00000100:00100000:3.0:1769074957.102802:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296448 00002000:00100000:3.0:1769074957.102815:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xdd:0x0] (0->157) req@ffff91604ac90000 x1855007616296448/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.102822:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90000 with x1855007616296448 ext(0->157) 00002000:00010000:3.0:1769074957.102825:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90000 00000100:00100000:3.0:1769074957.102833:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 877 00000100:00100000:3.0:1769074957.102840:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+255:2418:x1855007616295168:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.103258:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2417:x1855007616294144:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3391us (4787us total) trans 4294967955 rc 0/0 00000100:00100000:2.0:1769074957.103266:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 871 00002000:00100000:2.0:1769074957.103274:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xd6:0x0] (0->157) req@ffff916049eb5880 x1855007616294144/t4294967955(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.103282:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb5880 with x1855007616294144 ext(0->157) 00002000:00010000:2.0:1769074957.103286:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb5880 00000100:00100000:2.0:1769074957.103306:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 878 00000100:00100000:2.0:1769074957.103314:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+255:2418:x1855007616295296:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.103873:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 879 00000100:00100000:3.0:1769074957.103882:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+257:2417:x1855007616295040:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.104579:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 880 00000100:00100000:1.0:1769074957.104588:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+260:2417:x1855007616295680:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.105012:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:2418:x1855007616294272:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4537us (6439us total) trans 4294967953 rc 0/0 00000100:00100000:0.0:1769074957.105021:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 873 00000100:00100000:2.0:1769074957.105449:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2418:x1855007616295296:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2134us (6740us total) trans 4294967969 rc 0/0 00000100:00100000:2.0:1769074957.105457:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 878 00002000:00100000:2.0:1769074957.105465:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xdb:0x0] (0->157) req@ffff916049eb4e00 x1855007616295296/t4294967969(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.105474:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4e00 with x1855007616295296 ext(0->157) 00002000:00010000:2.0:1769074957.105479:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb4e00 00000100:00100000:2.0:1769074957.105502:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 881 00000100:00100000:2.0:1769074957.105510:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:2417:x1855007616295936:12345-192.168.204.32@tcp:4:cp.0 00002000:00100000:0.0:1769074957.106302:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xbe:0x0] (0->157) req@ffff916049eb6d80 x1855007616294272/t4294967953(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.106313:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6d80 with x1855007616294272 ext(0->157) 00002000:00010000:0.0:1769074957.106318:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6d80 00000100:00100000:0.0:1769074957.106341:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 882 00000100:00100000:0.0:1769074957.106350:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+260:2417:x1855007616295552:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.106637:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+262:2417:x1855007616294528:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5960us (8042us total) trans 4294967954 rc 0/0 00000100:00100000:0.0:1769074957.106644:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 874 00002000:00100000:0.0:1769074957.106651:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (0->157) req@ffff916049eb4a80 x1855007616294528/t4294967954(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.106659:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb4a80 with x1855007616294528 ext(0->157) 00002000:00010000:0.0:1769074957.106664:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb4a80 00000100:00100000:0.0:1769074957.106678:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 883 00000100:00100000:0.0:1769074957.106684:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+261:2417:x1855007616295808:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.106862:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2417:x1855007616294784:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5998us (8212us total) trans 4294967968 rc 0/0 00000100:00100000:0.0:1769074957.106869:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 875 00002000:00100000:0.0:1769074957.106875:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xd9:0x0] (0->157) req@ffff916049eb7100 x1855007616294784/t4294967968(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.106883:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb7100 with x1855007616294784 ext(0->157) 00002000:00010000:0.0:1769074957.106887:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb7100 00000100:00100000:0.0:1769074957.106901:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 884 00000100:00100000:0.0:1769074957.106907:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916049eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+263:2417:x1855007616294656:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.107365:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2418:x1855007616294400:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7212us (8842us total) trans 4294967952 rc 0/0 00000100:00100000:1.0:1769074957.107373:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 872 00002000:00100000:1.0:1769074957.107379:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xd7:0x0] (0->157) req@ffff916049eb6a00 x1855007616294400/t4294967952(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.107387:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6a00 with x1855007616294400 ext(0->157) 00002000:00010000:1.0:1769074957.107391:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6a00 00000100:00100000:1.0:1769074957.107408:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 885 00000100:00100000:1.0:1769074957.107416:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+264:2417:x1855007616296064:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.107708:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2418:x1855007616294912:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5769us (9037us total) trans 4294967966 rc 0/0 00000100:00100000:1.0:1769074957.107716:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 876 00002000:00100000:1.0:1769074957.107723:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xc0:0x0] (0->157) req@ffff916049eb5180 x1855007616294912/t4294967966(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.107732:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb5180 with x1855007616294912 ext(0->157) 00002000:00010000:1.0:1769074957.107737:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb5180 00000100:00100000:1.0:1769074957.107755:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 886 00000100:00100000:1.0:1769074957.107763:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2418:x1855007616296320:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.107978:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2417:x1855007616295680:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3390us (9234us total) trans 4294967967 rc 0/0 00000100:00100000:1.0:1769074957.107985:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 880 00002000:00100000:1.0:1769074957.107990:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xdc:0x0] (0->157) req@ffff9160434b0000 x1855007616295680/t4294967967(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.107998:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0000 with x1855007616295680 ext(0->157) 00002000:00010000:1.0:1769074957.108001:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0000 00000100:00100000:1.0:1769074957.108016:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 887 00000100:00100000:1.0:1769074957.108022:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2418:x1855007616296192:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.108362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.108439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.108496:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296704 00000100:00100000:3.0:1769074957.108503:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296704 00000100:00100000:3.0:1769074957.108555:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2911 00000100:00100000:3.0:1769074957.108564:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2419:x1855007616296704:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:3.0:1769074957.108637:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2419:x1855007616296704:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074957.108644:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2911 00000100:00100000:2.0:1769074957.108861:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2417:x1855007616295040:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4978us (10133us total) trans 4294967972 rc 0/0 00000100:00100000:2.0:1769074957.108869:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 879 00002000:00100000:2.0:1769074957.108875:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xda:0x0] (0->157) req@ffff9160434b0380 x1855007616295040/t4294967972(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.108885:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b0380 with x1855007616295040 ext(0->157) 00002000:00010000:2.0:1769074957.108889:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b0380 00000100:00100000:2.0:1769074957.108901:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296576 00000100:00100000:2.0:1769074957.108904:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296576 00002000:00100000:2.0:1769074957.108920:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xde:0x0] (0->157) req@ffff91604ac90e00 x1855007616296576/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.108928:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90e00 with x1855007616296576 ext(0->157) 00002000:00010000:2.0:1769074957.108932:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90e00 00000100:00100000:2.0:1769074957.108940:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 888 00000100:00100000:2.0:1769074957.108946:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2418:x1855007616296448:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.108994:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2418:x1855007616295168:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6154us (10306us total) trans 4294967965 rc 0/0 00000100:00100000:2.0:1769074957.109001:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 877 00002000:00100000:2.0:1769074957.109005:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xca:0x0] (0->157) req@ffff916049eb7b80 x1855007616295168/t4294967965(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.109012:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb7b80 with x1855007616295168 ext(0->157) 00002000:00010000:2.0:1769074957.109016:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916049eb7b80 00000100:00100000:2.0:1769074957.109162:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 889 00000100:00100000:2.0:1769074957.109173:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2417:x1855007616296576:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.109908:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916049eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+267:2417:x1855007616294656:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2997us (11288us total) trans 4294967958 rc 0/0 00000100:00100000:0.0:1769074957.109916:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 884 00002000:00100000:0.0:1769074957.109923:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd8:0x0] (0->157) req@ffff916049eb6680 x1855007616294656/t4294967958(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.109930:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916049eb6680 with x1855007616294656 ext(0->157) 00002000:00010000:0.0:1769074957.109935:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916049eb6680 00000100:00100000:0.0:1769074957.111993:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+266:2417:x1855007616295936:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6473us (13223us total) trans 4294967959 rc 0/0 00000100:00100000:0.0:1769074957.112007:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 881 00002000:00100000:0.0:1769074957.112019:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xdc:0x0] (0->157) req@ffff9160434b2680 x1855007616295936/t4294967959(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.112048:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b2680 with x1855007616295936 ext(0->157) 00002000:00010000:0.0:1769074957.112054:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b2680 00000100:00100000:1.0:1769074957.112220:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2417:x1855007616296064:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4803us (9764us total) trans 4294967970 rc 0/0 00000100:00100000:1.0:1769074957.112228:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 885 00002000:00100000:1.0:1769074957.112234:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xdd:0x0] (0->157) req@ffff91604ac91880 x1855007616296064/t4294967970(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.112243:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91880 with x1855007616296064 ext(0->157) 00002000:00010000:1.0:1769074957.112246:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91880 00000100:00100000:1.0:1769074957.112287:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+264:2418:x1855007616296320:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4526us (9812us total) trans 4294967971 rc 0/0 00000100:00100000:1.0:1769074957.112295:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 886 00002000:00100000:1.0:1769074957.112300:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xde:0x0] (0->157) req@ffff91604ac92a00 x1855007616296320/t4294967971(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.112315:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac92a00 with x1855007616296320 ext(0->157) 00002000:00010000:1.0:1769074957.112319:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac92a00 00000100:00100000:3.0:1769074957.115755:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2417:x1855007616295808:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9059us (16952us total) trans 4294967957 rc 0/0 00000100:00100000:3.0:1769074957.115772:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 883 00002000:00100000:3.0:1769074957.115784:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xdb:0x0] (0->157) req@ffff9160434b3800 x1855007616295808/t4294967957(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.115793:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b3800 with x1855007616295808 ext(0->157) 00002000:00010000:3.0:1769074957.115799:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b3800 00000100:00100000:1.0:1769074957.121511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.121574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.121595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.121634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.121667:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296832 00000100:00100000:1.0:1769074957.121677:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296832 00002000:00100000:1.0:1769074957.121725:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xbc:0x0] (0->157) req@ffff9160434b2a00 x1855007616296832/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.121737:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b2a00 with x1855007616296832 ext(0->157) 00002000:00010000:1.0:1769074957.121744:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b2a00 00000100:00100000:1.0:1769074957.121772:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297088 00000100:00100000:1.0:1769074957.121776:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297088 00002000:00100000:1.0:1769074957.121790:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xc2:0x0] (0->157) req@ffff9160434b3100 x1855007616297088/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.121798:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b3100 with x1855007616297088 ext(0->157) 00002000:00010000:1.0:1769074957.121802:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b3100 00000100:00100000:1.0:1769074957.121815:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616296960 00000100:00100000:1.0:1769074957.121818:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616296960 00002000:00100000:1.0:1769074957.121830:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xcd:0x0] (0->157) req@ffff9160434b1500 x1855007616296960/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.121838:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1500 with x1855007616296960 ext(0->157) 00002000:00010000:1.0:1769074957.121841:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b1500 00000100:00100000:1.0:1769074957.121854:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297216 00000100:00100000:1.0:1769074957.121857:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297216 00002000:00100000:1.0:1769074957.121872:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xdf:0x0] (0->157) req@ffff9160434b1180 x1855007616297216/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.121879:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1180 with x1855007616297216 ext(0->157) 00002000:00010000:1.0:1769074957.121883:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b1180 00000100:00100000:1.0:1769074957.121894:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 890 00000100:00100000:1.0:1769074957.121902:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+268:2417:x1855007616296832:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.122320:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 891 00000100:00100000:1.0:1769074957.122328:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+270:2417:x1855007616297088:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.122598:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+272:2417:x1855007616296832:12345-192.168.204.32@tcp:4:cp.0 Request processed in 695us (1097us total) trans 4294967974 rc 0/0 00000100:00100000:1.0:1769074957.122607:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 890 00002000:00100000:1.0:1769074957.122624:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xbc:0x0] (0->157) req@ffff9160434b2a00 x1855007616296832/t4294967974(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.122650:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b2a00 with x1855007616296832 ext(0->157) 00002000:00010000:1.0:1769074957.122654:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b2a00 00000100:00100000:1.0:1769074957.122675:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 892 00000100:00100000:1.0:1769074957.122681:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+271:2417:x1855007616296960:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.122864:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:2417:x1855007616297088:12345-192.168.204.32@tcp:4:cp.0 Request processed in 536us (1288us total) trans 4294967975 rc 0/0 00000100:00100000:1.0:1769074957.122871:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 891 00002000:00100000:1.0:1769074957.122877:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xc2:0x0] (0->157) req@ffff9160434b3100 x1855007616297088/t4294967975(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.122891:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b3100 with x1855007616297088 ext(0->157) 00002000:00010000:1.0:1769074957.122895:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b3100 00000100:00100000:1.0:1769074957.122909:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 893 00000100:00100000:1.0:1769074957.122916:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+265:2417:x1855007616297216:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.123162:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+272:2417:x1855007616296960:12345-192.168.204.32@tcp:4:cp.0 Request processed in 480us (1565us total) trans 4294967976 rc 0/0 00000100:00100000:1.0:1769074957.123170:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 892 00002000:00100000:1.0:1769074957.123176:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xcd:0x0] (0->157) req@ffff9160434b1500 x1855007616296960/t4294967976(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.123183:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1500 with x1855007616296960 ext(0->157) 00002000:00010000:1.0:1769074957.123187:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9160434b1500 00000100:00100000:0.0:1769074957.123748:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2418:x1855007616296448:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14799us (21248us total) trans 4294967961 rc 0/0 00000100:00100000:0.0:1769074957.123756:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 888 00002000:00100000:0.0:1769074957.123762:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xdd:0x0] (0->157) req@ffff91604ac90000 x1855007616296448/t4294967961(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.123770:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90000 with x1855007616296448 ext(0->157) 00002000:00010000:0.0:1769074957.123774:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90000 00000100:00100000:3.0:1769074957.124026:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+271:2418:x1855007616296192:12345-192.168.204.32@tcp:4:cp.0 Request processed in 16002us (21538us total) trans 4294967973 rc 0/0 00000100:00100000:3.0:1769074957.124034:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 887 00002000:00100000:3.0:1769074957.124040:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc1:0x0] (0->157) req@ffff91604ac91c00 x1855007616296192/t4294967973(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.124048:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac91c00 with x1855007616296192 ext(0->157) 00002000:00010000:3.0:1769074957.124052:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604ac91c00 00000100:00100000:0.0:1769074957.124229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.124296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.124370:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297344 00000100:00100000:3.0:1769074957.124378:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297344 00000100:00100000:3.0:1769074957.124496:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2912 00000100:00100000:3.0:1769074957.124505:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616297344:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:3.0:1769074957.124589:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616297344:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074957.124596:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2912 00000100:00100000:3.0:1769074957.124611:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297472 00000100:00100000:3.0:1769074957.124626:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297472 00002000:00100000:3.0:1769074957.124645:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xce:0x0] (0->157) req@ffff91604b57f480 x1855007616297472/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.124653:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57f480 with x1855007616297472 ext(0->157) 00002000:00010000:3.0:1769074957.124657:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57f480 00000100:00100000:3.0:1769074957.124672:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 894 00000100:00100000:3.0:1769074957.124678:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+271:2418:x1855007616297472:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.125806:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:2418:x1855007616297472:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1121us (1502us total) trans 4294967977 rc 0/0 00000100:00100000:3.0:1769074957.125816:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 894 00002000:00100000:3.0:1769074957.125825:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xce:0x0] (0->157) req@ffff91604b57f480 x1855007616297472/t4294967977(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.125834:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57f480 with x1855007616297472 ext(0->157) 00002000:00010000:3.0:1769074957.125838:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57f480 00000100:00100000:2.0:1769074957.129225:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+268:2417:x1855007616297216:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6299us (7580us total) trans 4294967960 rc 0/0 00000100:00100000:2.0:1769074957.129239:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 893 00002000:00100000:2.0:1769074957.129249:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xdf:0x0] (0->157) req@ffff9160434b1180 x1855007616297216/t4294967960(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.129259:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1180 with x1855007616297216 ext(0->157) 00002000:00010000:2.0:1769074957.129265:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b1180 00000100:00100000:0.0:1769074957.129605:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9160434b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616295552:12345-192.168.204.32@tcp:4:cp.0 Request processed in 23255us (30832us total) trans 4294967956 rc 0/0 00000100:00100000:0.0:1769074957.129624:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 882 00002000:00100000:0.0:1769074957.129631:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0xda:0x0] (0->157) req@ffff9160434b1c00 x1855007616295552/t4294967956(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.129640:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9160434b1c00 with x1855007616295552 ext(0->157) 00002000:00010000:0.0:1769074957.129644:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9160434b1c00 00000100:00100000:3.0:1769074957.129932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.129996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.130072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.130092:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297600 00000100:00100000:3.0:1769074957.130101:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297600 00002000:00100000:3.0:1769074957.130134:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb8:0x0] (0->157) req@ffff916045a69880 x1855007616297600/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.130142:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69880 with x1855007616297600 ext(0->157) 00002000:00010000:3.0:1769074957.130145:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69880 00000100:00100000:3.0:1769074957.130161:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297856 00000100:00100000:3.0:1769074957.130164:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297856 00002000:00100000:3.0:1769074957.130178:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xbb:0x0] (0->157) req@ffff916045a68a80 x1855007616297856/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.130186:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68a80 with x1855007616297856 ext(0->157) 00002000:00010000:3.0:1769074957.130190:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68a80 00000100:00100000:0.0:1769074957.130251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.131574:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616296576:12345-192.168.204.32@tcp:4:cp.0 Request processed in 22396us (23206us total) trans 4294967962 rc 0/0 00000100:00100000:1.0:1769074957.131586:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 889 00002000:00100000:1.0:1769074957.131595:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xde:0x0] (0->157) req@ffff91604ac90e00 x1855007616296576/t4294967962(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.131605:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604ac90e00 with x1855007616296576 ext(0->157) 00002000:00010000:1.0:1769074957.131610:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604ac90e00 00000100:00100000:0.0:1769074957.131910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.132083:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298112 00000100:00100000:3.0:1769074957.132092:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298112 00002000:00100000:3.0:1769074957.132127:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (0->157) req@ffff916045a69500 x1855007616298112/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.132135:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69500 with x1855007616298112 ext(0->157) 00002000:00010000:3.0:1769074957.132139:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a69500 00000100:00100000:3.0:1769074957.132160:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297728 00000100:00100000:3.0:1769074957.132163:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297728 00002000:00100000:3.0:1769074957.132179:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd0:0x0] (0->157) req@ffff91604b57f800 x1855007616297728/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.132187:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57f800 with x1855007616297728 ext(0->157) 00002000:00010000:3.0:1769074957.132190:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57f800 00000100:00100000:3.0:1769074957.132208:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 895 00000100:00100000:3.0:1769074957.132217:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+274:2417:x1855007616297600:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.132472:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 896 00000100:00100000:2.0:1769074957.132482:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616297856:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.132603:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 897 00000100:00100000:3.0:1769074957.132611:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+269:2417:x1855007616298112:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.133215:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:2417:x1855007616297856:12345-192.168.204.32@tcp:4:cp.0 Request processed in 731us (3214us total) trans 4294967963 rc 0/0 00000100:00100000:2.0:1769074957.133224:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 896 00002000:00100000:2.0:1769074957.133231:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xbb:0x0] (0->157) req@ffff916045a68a80 x1855007616297856/t4294967963(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.133244:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68a80 with x1855007616297856 ext(0->157) 00002000:00010000:2.0:1769074957.133249:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68a80 00000100:00100000:2.0:1769074957.133268:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 898 00000100:00100000:2.0:1769074957.133275:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+276:2417:x1855007616297728:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.133937:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+278:2417:x1855007616297728:12345-192.168.204.32@tcp:4:cp.0 Request processed in 659us (3683us total) trans 4294967979 rc 0/0 00000100:00100000:2.0:1769074957.133946:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 898 00002000:00100000:2.0:1769074957.133953:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xd0:0x0] (0->157) req@ffff91604b57f800 x1855007616297728/t4294967979(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.133960:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57f800 with x1855007616297728 ext(0->157) 00002000:00010000:2.0:1769074957.133964:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b57f800 00000100:00100000:2.0:1769074957.134153:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007616297600:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1936us (4220us total) trans 4294967978 rc 0/0 00000100:00100000:2.0:1769074957.134161:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 895 00000100:00100000:3.0:1769074957.134163:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+272:2417:x1855007616298112:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1551us (4090us total) trans 4294967964 rc 0/0 00002000:00100000:2.0:1769074957.134167:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb8:0x0] (0->157) req@ffff916045a69880 x1855007616297600/t4294967978(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1769074957.134171:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 897 00002000:00100000:2.0:1769074957.134176:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69880 with x1855007616297600 ext(0->157) 00002000:00100000:3.0:1769074957.134176:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->157) req@ffff916045a69500 x1855007616298112/t4294967964(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00010000:2.0:1769074957.134180:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69880 00002000:00100000:3.0:1769074957.134184:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69500 with x1855007616298112 ext(0->157) 00002000:00010000:3.0:1769074957.134188:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a69500 00000100:00100000:0.0:1769074957.144184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.144218:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616297984 00000100:00100000:0.0:1769074957.144229:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616297984 00002000:00100000:0.0:1769074957.144279:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xe1:0x0] (0->157) req@ffff91604b57fb80 x1855007616297984/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.144291:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57fb80 with x1855007616297984 ext(0->157) 00002000:00010000:0.0:1769074957.144298:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57fb80 00000100:00100000:0.0:1769074957.144326:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298240 00000100:00100000:0.0:1769074957.144329:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298240 00002000:00100000:0.0:1769074957.144344:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xc1:0x0] (0->157) req@ffff91604b57e680 x1855007616298240/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.144352:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57e680 with x1855007616298240 ext(0->157) 00002000:00010000:0.0:1769074957.144356:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57e680 00000100:00100000:0.0:1769074957.144370:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 899 00000100:00100000:0.0:1769074957.144379:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:2417:x1855007616297984:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.144431:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 900 00000100:00100000:2.0:1769074957.144441:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+273:2417:x1855007616298240:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.145660:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007616298240:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1215us (1479us total) trans 4294967965 rc 0/0 00000100:00100000:2.0:1769074957.145674:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 900 00002000:00100000:2.0:1769074957.145683:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc1:0x0] (0->157) req@ffff91604b57e680 x1855007616298240/t4294967965(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.145691:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57e680 with x1855007616298240 ext(0->157) 00002000:00010000:2.0:1769074957.145696:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57e680 00000100:00100000:3.0:1769074957.146780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.147090:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+276:2417:x1855007616297984:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2709us (15178us total) trans 4294967966 rc 0/0 00000100:00100000:0.0:1769074957.147101:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 899 00002000:00100000:0.0:1769074957.147111:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xe1:0x0] (0->157) req@ffff91604b57fb80 x1855007616297984/t4294967966(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.147120:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57fb80 with x1855007616297984 ext(0->157) 00002000:00010000:0.0:1769074957.147125:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57fb80 00000100:00100000:0.0:1769074957.147146:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298368 00000100:00100000:0.0:1769074957.147152:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298368 00002000:00100000:0.0:1769074957.147182:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xd2:0x0] (0->157) req@ffff916045a6b100 x1855007616298368/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.147191:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b100 with x1855007616298368 ext(0->157) 00002000:00010000:0.0:1769074957.147194:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6b100 00000100:00100000:0.0:1769074957.147218:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 901 00000100:00100000:0.0:1769074957.147227:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2417:x1855007616298368:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.153397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.153435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.153471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.153489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.153516:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298496 00000100:00100000:3.0:1769074957.153526:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298496 00002000:00100000:3.0:1769074957.153609:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xb7:0x0] (0->157) req@ffff916045a68000 x1855007616298496/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.153654:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68000 with x1855007616298496 ext(0->157) 00002000:00010000:3.0:1769074957.153660:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68000 00000100:00100000:3.0:1769074957.153680:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298752 00000100:00100000:3.0:1769074957.153684:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298752 00002000:00100000:3.0:1769074957.153699:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xd4:0x0] (0->157) req@ffff916045a69180 x1855007616298752/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.153707:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69180 with x1855007616298752 ext(0->157) 00002000:00010000:3.0:1769074957.153711:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69180 00000100:00100000:3.0:1769074957.153721:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299008 00000100:00100000:3.0:1769074957.153724:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299008 00002000:00100000:3.0:1769074957.153737:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xb7:0x0] (0->157) req@ffff916045a6b800 x1855007616299008/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.153745:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b800 with x1855007616299008 ext(0->157) 00002000:00010000:3.0:1769074957.153748:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6b800 00000100:00100000:3.0:1769074957.153758:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299264 00000100:00100000:3.0:1769074957.153761:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299264 00002000:00100000:3.0:1769074957.153774:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xd3:0x0] (0->157) req@ffff916045a69f80 x1855007616299264/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.153782:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69f80 with x1855007616299264 ext(0->157) 00002000:00010000:3.0:1769074957.153786:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a69f80 00000100:00100000:3.0:1769074957.153803:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 902 00000100:00100000:3.0:1769074957.153812:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+277:2418:x1855007616298496:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.154216:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 903 00000100:00100000:3.0:1769074957.154223:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+281:2418:x1855007616298752:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.154424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154487:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154498:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.154512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.154627:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299520 00000100:00100000:1.0:1769074957.154632:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299520 00002000:00100000:1.0:1769074957.154655:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xcb:0x0] (0->157) req@ffff916045a6ad80 x1855007616299520/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154663:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6ad80 with x1855007616299520 ext(0->157) 00002000:00010000:1.0:1769074957.154668:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6ad80 00000100:00100000:1.0:1769074957.154678:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299776 00000100:00100000:1.0:1769074957.154680:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299776 00002000:00100000:1.0:1769074957.154692:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xdf:0x0] (0->157) req@ffff916045a6a300 x1855007616299776/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154700:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6a300 with x1855007616299776 ext(0->157) 00002000:00010000:1.0:1769074957.154704:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6a300 00000100:00100000:1.0:1769074957.154709:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298624 00000100:00100000:1.0:1769074957.154712:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298624 00002000:00100000:1.0:1769074957.154721:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc3:0x0] (0->157) req@ffff916045a68e00 x1855007616298624/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154728:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68e00 with x1855007616298624 ext(0->157) 00002000:00010000:1.0:1769074957.154731:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68e00 00000100:00100000:1.0:1769074957.154736:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616298880 00000100:00100000:1.0:1769074957.154738:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616298880 00002000:00100000:1.0:1769074957.154745:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xbe:0x0] (0->157) req@ffff916045a68380 x1855007616298880/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154752:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68380 with x1855007616298880 ext(0->157) 00002000:00010000:1.0:1769074957.154755:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68380 00000100:00100000:1.0:1769074957.154759:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299136 00000100:00100000:1.0:1769074957.154762:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299136 00002000:00100000:1.0:1769074957.154770:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xc9:0x0] (0->157) req@ffff916045a6aa00 x1855007616299136/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154777:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6aa00 with x1855007616299136 ext(0->157) 00002000:00010000:1.0:1769074957.154779:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6aa00 00000100:00100000:1.0:1769074957.154784:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299392 00000100:00100000:1.0:1769074957.154787:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299392 00002000:00100000:1.0:1769074957.154797:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd5:0x0] (0->157) req@ffff91617f921180 x1855007616299392/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154804:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921180 with x1855007616299392 ext(0->157) 00002000:00010000:1.0:1769074957.154807:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f921180 00000100:00100000:1.0:1769074957.154812:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299648 00000100:00100000:1.0:1769074957.154815:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299648 00002000:00100000:1.0:1769074957.154826:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd9:0x0] (0->157) req@ffff91617f923100 x1855007616299648/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154833:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923100 with x1855007616299648 ext(0->157) 00002000:00010000:1.0:1769074957.154836:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f923100 00000100:00100000:1.0:1769074957.154842:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616299904 00000100:00100000:1.0:1769074957.154844:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616299904 00002000:00100000:1.0:1769074957.154856:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xbf:0x0] (0->157) req@ffff91617f921500 x1855007616299904/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.154863:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921500 with x1855007616299904 ext(0->157) 00002000:00010000:1.0:1769074957.154866:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f921500 00000100:00100000:1.0:1769074957.154875:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 904 00000100:00100000:1.0:1769074957.154881:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+287:2418:x1855007616299008:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.155078:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 905 00000100:00100000:1.0:1769074957.155084:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+283:2418:x1855007616299264:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.155270:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 906 00000100:00100000:1.0:1769074957.155278:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+289:2418:x1855007616299520:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.155439:0:44304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 907 00000100:00100000:1.0:1769074957.155447:0:44304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+291:2418:x1855007616299776:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.155860:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 908 00000100:00100000:0.0:1769074957.155870:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+285:2418:x1855007616298624:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.156184:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+293:2417:x1855007616298368:12345-192.168.204.32@tcp:4:cp.0 Request processed in 8956us (9409us total) trans 4294967980 rc 0/0 00000100:00100000:1.0:1769074957.156193:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 901 00002000:00100000:1.0:1769074957.156202:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xd2:0x0] (0->157) req@ffff916045a6b100 x1855007616298368/t4294967980(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.156212:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b100 with x1855007616298368 ext(0->157) 00002000:00010000:1.0:1769074957.156217:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6b100 00000100:00100000:1.0:1769074957.156239:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 909 00000100:00100000:1.0:1769074957.156247:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2418:x1855007616298880:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.157295:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 910 00000100:00100000:2.0:1769074957.157308:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916045a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+294:2418:x1855007616299136:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.157800:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+287:2418:x1855007616298624:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1929us (3343us total) trans 4294967969 rc 0/0 00000100:00100000:0.0:1769074957.157809:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 908 00002000:00100000:0.0:1769074957.157818:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xc3:0x0] (0->157) req@ffff916045a68e00 x1855007616298624/t4294967969(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.157828:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68e00 with x1855007616298624 ext(0->157) 00002000:00010000:0.0:1769074957.157833:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68e00 00000100:00100000:0.0:1769074957.157855:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 911 00000100:00100000:0.0:1769074957.157861:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+286:2418:x1855007616299392:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.158072:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:2418:x1855007616299136:12345-192.168.204.32@tcp:4:cp.0 Request processed in 767us (3596us total) trans 4294967986 rc 0/0 00000100:00100000:2.0:1769074957.158079:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 910 00002000:00100000:2.0:1769074957.158085:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xc9:0x0] (0->157) req@ffff916045a6aa00 x1855007616299136/t4294967986(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.158092:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6aa00 with x1855007616299136 ext(0->157) 00002000:00010000:2.0:1769074957.158097:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6aa00 00000100:00100000:2.0:1769074957.158111:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 912 00000100:00100000:2.0:1769074957.158118:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+288:2418:x1855007616299648:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.158282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.158337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.158403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074957.158449:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+295:2418:x1855007616298880:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2203us (3985us total) trans 4294967985 rc 0/0 00000100:00100000:1.0:1769074957.158457:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 909 00002000:00100000:1.0:1769074957.158463:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xbe:0x0] (0->157) req@ffff916045a68380 x1855007616298880/t4294967985(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.158471:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68380 with x1855007616298880 ext(0->157) 00002000:00010000:1.0:1769074957.158475:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a68380 00000100:00100000:1.0:1769074957.158488:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300032 00000100:00100000:1.0:1769074957.158494:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300032 00002000:00100000:1.0:1769074957.158520:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xe1:0x0] (0->157) req@ffff91604b148000 x1855007616300032/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1769074957.158520:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300160 00000100:00100000:2.0:1769074957.158524:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300160 00002000:00100000:1.0:1769074957.158551:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b148000 with x1855007616300032 ext(0->157) 00002000:00010000:1.0:1769074957.158555:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b148000 00002000:00100000:2.0:1769074957.158558:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xe2:0x0] (0->157) req@ffff91604b14b800 x1855007616300160/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1769074957.158565:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300288 00002000:00100000:2.0:1769074957.158565:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b14b800 with x1855007616300160 ext(0->157) 00000100:00100000:1.0:1769074957.158567:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300288 00002000:00010000:2.0:1769074957.158568:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b14b800 00000100:00100000:2.0:1769074957.158578:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 913 00000100:00100000:2.0:1769074957.158584:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+291:2418:x1855007616299904:12345-192.168.204.32@tcp:4:cp.0 00002000:00100000:1.0:1769074957.158594:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xb8:0x0] (0->157) req@ffff91604b148e00 x1855007616300288/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.158601:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b148e00 with x1855007616300288 ext(0->157) 00002000:00010000:1.0:1769074957.158605:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b148e00 00000100:00100000:1.0:1769074957.158656:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+291:2418:x1855007616299264:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3571us (5165us total) trans 4294967968 rc 0/0 00000100:00100000:1.0:1769074957.158663:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 905 00002000:00100000:1.0:1769074957.158669:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xd3:0x0] (0->157) req@ffff916045a69f80 x1855007616299264/t4294967968(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.158677:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69f80 with x1855007616299264 ext(0->157) 00002000:00010000:1.0:1769074957.158681:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a69f80 00000100:00100000:1.0:1769074957.158696:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 914 00000100:00100000:1.0:1769074957.158703:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+296:2418:x1855007616300032:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.158900:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2418:x1855007616299520:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3622us (4474us total) trans 4294967983 rc 0/0 00000100:00100000:1.0:1769074957.158908:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 906 00002000:00100000:1.0:1769074957.158914:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xcb:0x0] (0->157) req@ffff916045a6ad80 x1855007616299520/t4294967983(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.158922:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6ad80 with x1855007616299520 ext(0->157) 00002000:00010000:1.0:1769074957.158927:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6ad80 00000100:00100000:1.0:1769074957.158940:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 915 00000100:00100000:1.0:1769074957.158947:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2418:x1855007616300160:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.159475:0:44304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2418:x1855007616299776:12345-192.168.204.32@tcp:4:cp.0 Request processed in 4026us (5030us total) trans 4294967984 rc 0/0 00000100:00100000:1.0:1769074957.159484:0:44304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 907 00002000:00100000:1.0:1769074957.159508:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xdf:0x0] (0->157) req@ffff916045a6a300 x1855007616299776/t4294967984(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.159515:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6a300 with x1855007616299776 ext(0->157) 00002000:00010000:1.0:1769074957.159519:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6a300 00000100:00100000:2.0:1769074957.168358:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2418:x1855007616300032:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9640us (10062us total) trans 4294967987 rc 0/0 00000100:00100000:2.0:1769074957.168373:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 914 00002000:00100000:2.0:1769074957.168388:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xe1:0x0] (0->157) req@ffff91604b148000 x1855007616300032/t4294967987(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.168399:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b148000 with x1855007616300032 ext(0->157) 00002000:00010000:2.0:1769074957.168406:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b148000 00000100:00100000:2.0:1769074957.168442:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 916 00000100:00100000:2.0:1769074957.168454:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2417:x1855007616300288:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.168660:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2418:x1855007616298752:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14435us (15222us total) trans 4294967981 rc 0/0 00000100:00100000:3.0:1769074957.168668:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 903 00002000:00100000:3.0:1769074957.168674:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd4:0x0] (0->157) req@ffff916045a69180 x1855007616298752/t4294967981(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.168682:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a69180 with x1855007616298752 ext(0->157) 00002000:00010000:3.0:1769074957.168686:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a69180 00000100:00100000:3.0:1769074957.168756:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2418:x1855007616298496:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14943us (15368us total) trans 4294967967 rc 0/0 00000100:00100000:3.0:1769074957.168763:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 902 00002000:00100000:3.0:1769074957.168769:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xb7:0x0] (0->157) req@ffff916045a68000 x1855007616298496/t4294967967(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.168784:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a68000 with x1855007616298496 ext(0->157) 00002000:00010000:3.0:1769074957.168788:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff916045a68000 00000100:00100000:3.0:1769074957.168884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.168907:0:44560:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300416 00000100:00100000:3.0:1769074957.168914:0:44560:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300416 00002000:00100000:3.0:1769074957.168941:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xc0:0x0] (0->157) req@ffff91617f923480 x1855007616300416/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.168949:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923480 with x1855007616300416 ext(0->157) 00002000:00010000:3.0:1769074957.168953:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f923480 00000100:00100000:3.0:1769074957.168969:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 917 00000100:00100000:3.0:1769074957.168976:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+292:2417:x1855007616300416:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.169278:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.169293:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300672 00000100:00100000:3.0:1769074957.169297:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300672 00002000:00100000:3.0:1769074957.169314:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd1:0x0] (0->157) req@ffff91617f920380 x1855007616300672/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.169647:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920380 with x1855007616300672 ext(0->157) 00002000:00010000:3.0:1769074957.169653:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f920380 00000100:00100000:3.0:1769074957.169676:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 918 00000100:00100000:3.0:1769074957.169684:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2417:x1855007616300672:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.169932:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+294:2417:x1855007616300416:12345-192.168.204.32@tcp:4:cp.0 Request processed in 955us (1047us total) trans 4294967973 rc 0/0 00000100:00100000:3.0:1769074957.169939:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 917 00002000:00100000:3.0:1769074957.169946:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xc0:0x0] (0->157) req@ffff91617f923480 x1855007616300416/t4294967973(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.169954:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923480 with x1855007616300416 ext(0->157) 00002000:00010000:3.0:1769074957.169958:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f923480 00000100:00100000:3.0:1769074957.170011:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2417:x1855007616300672:12345-192.168.204.32@tcp:4:cp.0 Request processed in 328us (734us total) trans 4294967989 rc 0/0 00000100:00100000:3.0:1769074957.170018:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 918 00002000:00100000:3.0:1769074957.170023:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd1:0x0] (0->157) req@ffff91617f920380 x1855007616300672/t4294967989(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1769074957.170215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.170271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.170416:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916045a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2418:x1855007616299008:12345-192.168.204.32@tcp:4:cp.0 Request processed in 15534us (16943us total) trans 4294967982 rc 0/0 00000100:00100000:0.0:1769074957.170423:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 904 00002000:00100000:0.0:1769074957.170430:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb7:0x0] (0->157) req@ffff916045a6b800 x1855007616299008/t4294967982(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.170437:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff916045a6b800 with x1855007616299008 ext(0->157) 00002000:00010000:0.0:1769074957.170441:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff916045a6b800 00000100:00100000:0.0:1769074957.170455:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300544 00000100:00100000:0.0:1769074957.170459:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300544 00002000:00100000:0.0:1769074957.170481:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xe0:0x0] (0->157) req@ffff91604b57df80 x1855007616300544/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.170489:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57df80 with x1855007616300544 ext(0->157) 00002000:00010000:0.0:1769074957.170493:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57df80 00000100:00100000:0.0:1769074957.170501:0:26191:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300800 00000100:00100000:0.0:1769074957.170504:0:26191:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300800 00002000:00100000:0.0:1769074957.170516:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcd:0x0] (0->157) req@ffff91617735ed80 x1855007616300800/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.170523:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617735ed80 with x1855007616300800 ext(0->157) 00002000:00010000:0.0:1769074957.170527:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617735ed80 00000100:00100000:0.0:1769074957.170553:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 919 00000100:00100000:0.0:1769074957.170560:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+295:2418:x1855007616300544:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.170833:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 920 00000100:00100000:0.0:1769074957.170841:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2418:x1855007616300800:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.171247:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2418:x1855007616300544:12345-192.168.204.32@tcp:4:cp.0 Request processed in 686us (1031us total) trans 4294967974 rc 0/0 00000100:00100000:0.0:1769074957.171255:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 919 00002000:00100000:0.0:1769074957.171261:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xe0:0x0] (0->157) req@ffff91604b57df80 x1855007616300544/t4294967974(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.171269:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b57df80 with x1855007616300544 ext(0->157) 00002000:00010000:0.0:1769074957.171273:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b57df80 00002000:00100000:3.0:1769074957.171865:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920380 with x1855007616300672 ext(0->157) 00002000:00010000:3.0:1769074957.171871:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f920380 00000100:00100000:0.0:1769074957.172044:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:2418:x1855007616300800:12345-192.168.204.32@tcp:4:cp.0 Request processed in 485us (1053us total) trans 4294967975 rc 0/0 00000100:00100000:2.0:1769074957.172045:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:2418:x1855007616299648:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13926us (17544us total) trans 4294967971 rc 0/0 00000100:00100000:0.0:1769074957.172052:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 920 00002000:00100000:0.0:1769074957.172060:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xcd:0x0] (0->157) req@ffff91617735ed80 x1855007616300800/t4294967975(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.172072:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617735ed80 with x1855007616300800 ext(0->157) 00002000:00010000:0.0:1769074957.172077:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617735ed80 00000100:00100000:0.0:1769074957.172134:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2418:x1855007616299392:12345-192.168.204.32@tcp:4:cp.0 Request processed in 14273us (17646us total) trans 4294967970 rc 0/0 00000100:00100000:1.0:1769074957.172525:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2418:x1855007616300160:12345-192.168.204.32@tcp:4:cp.0 Request processed in 13576us (14184us total) trans 4294967988 rc 0/0 00000100:00100000:3.0:1769074957.174488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.177974:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+299:2417:x1855007616300288:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9505us (19550us total) trans 4294967976 rc 0/0 00000100:00100000:2.0:1769074957.178014:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 912 00000100:00100000:0.0:1769074957.178022:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 911 00002000:00100000:2.0:1769074957.178033:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd9:0x0] (0->157) req@ffff91617f923100 x1855007616299648/t4294967971(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.178042:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0xd5:0x0] (0->157) req@ffff91617f921180 x1855007616299392/t4294967970(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.178043:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923100 with x1855007616299648 ext(0->157) 00002000:00100000:0.0:1769074957.178050:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921180 with x1855007616299392 ext(0->157) 00002000:00010000:2.0:1769074957.178050:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f923100 00002000:00010000:0.0:1769074957.178054:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f921180 00000100:00100000:0.0:1769074957.178081:0:44302:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301056 00000100:00100000:0.0:1769074957.178087:0:44302:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301056 00000100:00100000:2.0:1769074957.178119:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+297:2418:x1855007616299904:12345-192.168.204.32@tcp:4:cp.0 Request processed in 19534us (23605us total) trans 4294967972 rc 0/0 00002000:00100000:0.0:1769074957.178123:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb9:0x0] (0->157) req@ffff91617f921f80 x1855007616301056/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1769074957.178125:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 913 00002000:00100000:2.0:1769074957.178131:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xbf:0x0] (0->157) req@ffff91617f921500 x1855007616299904/t4294967972(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.178132:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921f80 with x1855007616301056 ext(0->157) 00002000:00010000:0.0:1769074957.178135:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f921f80 00002000:00100000:2.0:1769074957.178138:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921500 with x1855007616299904 ext(0->157) 00002000:00010000:2.0:1769074957.178142:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f921500 00000100:00100000:0.0:1769074957.178154:0:44302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 921 00000100:00100000:0.0:1769074957.178162:0:44302:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2418:x1855007616301056:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.179001:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 915 00002000:00100000:1.0:1769074957.179013:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xe2:0x0] (0->157) req@ffff91604b14b800 x1855007616300160/t4294967988(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.179024:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b14b800 with x1855007616300160 ext(0->157) 00000100:00100000:0.0:1769074957.179463:0:44302:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+300:2418:x1855007616301056:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1300us (4983us total) trans 4294967990 rc 0/0 00000100:00100000:0.0:1769074957.179473:0:44302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 921 00002000:00100000:0.0:1769074957.179480:0:44302:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xb9:0x0] (0->157) req@ffff91617f921f80 x1855007616301056/t4294967990(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.179495:0:44302:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f921f80 with x1855007616301056 ext(0->157) 00002000:00010000:0.0:1769074957.179500:0:44302:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f921f80 00002000:00010000:1.0:1769074957.179573:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91604b14b800 00000100:00100000:3.0:1769074957.185573:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 916 00002000:00100000:3.0:1769074957.185598:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xb8:0x0] (0->157) req@ffff91604b148e00 x1855007616300288/t4294967976(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.185610:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91604b148e00 with x1855007616300288 ext(0->157) 00002000:00010000:3.0:1769074957.185628:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91604b148e00 00000100:00100000:3.0:1769074957.185780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.185894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.185924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.185941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.186000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.186020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074957.186145:0:44304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616300928 00000100:00100000:0.0:1769074957.186154:0:44304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616300928 00002000:00100000:0.0:1769074957.186195:0:44304:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0xc6:0x0] (0->157) req@ffff91617f923b80 x1855007616300928/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186204:0:44304:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923b80 with x1855007616300928 ext(0->157) 00002000:00010000:0.0:1769074957.186209:0:44304:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f923b80 00000100:00100000:0.0:1769074957.186232:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301184 00000100:00100000:0.0:1769074957.186235:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301184 00002000:00100000:0.0:1769074957.186251:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xd2:0x0] (0->157) req@ffff91617f920e00 x1855007616301184/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186259:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920e00 with x1855007616301184 ext(0->157) 00002000:00010000:0.0:1769074957.186263:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f920e00 00000100:00100000:0.0:1769074957.186275:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301440 00000100:00100000:0.0:1769074957.186277:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301440 00002000:00100000:0.0:1769074957.186310:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xe0:0x0] (0->157) req@ffff91617f920700 x1855007616301440/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186318:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920700 with x1855007616301440 ext(0->157) 00002000:00010000:0.0:1769074957.186322:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f920700 00000100:00100000:0.0:1769074957.186336:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301696 00000100:00100000:0.0:1769074957.186339:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301696 00002000:00100000:0.0:1769074957.186351:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xc9:0x0] (0->157) req@ffff91615e547480 x1855007616301696/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186358:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547480 with x1855007616301696 ext(0->157) 00002000:00010000:0.0:1769074957.186362:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547480 00000100:00100000:0.0:1769074957.186372:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301952 00000100:00100000:0.0:1769074957.186375:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301952 00002000:00100000:0.0:1769074957.186385:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0xd0:0x0] (0->157) req@ffff91615e544700 x1855007616301952/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186392:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544700 with x1855007616301952 ext(0->157) 00002000:00010000:0.0:1769074957.186395:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544700 00000100:00100000:0.0:1769074957.186399:0:41795:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302208 00000100:00100000:0.0:1769074957.186401:0:41795:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302208 00002000:00100000:0.0:1769074957.186409:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xbb:0x0] (0->157) req@ffff91615e546d80 x1855007616302208/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.186416:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546d80 with x1855007616302208 ext(0->157) 00002000:00010000:0.0:1769074957.186419:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546d80 00000100:00100000:0.0:1769074957.186429:0:41795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 922 00000100:00100000:0.0:1769074957.186436:0:41795:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+301:2417:x1855007616300928:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.186882:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 923 00000100:00100000:0.0:1769074957.186890:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2417:x1855007616301184:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.187197:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 924 00000100:00100000:2.0:1769074957.187207:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+303:2417:x1855007616301440:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.187407:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 925 00000100:00100000:2.0:1769074957.187414:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2417:x1855007616301696:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.187722:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 926 00000100:00100000:1.0:1769074957.187732:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+298:2417:x1855007616301952:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.187916:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 927 00000100:00100000:1.0:1769074957.187923:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+305:2417:x1855007616302208:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.188522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.188563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.188578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.188591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.188609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.188645:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301312 00000100:00100000:3.0:1769074957.188653:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301312 00002000:00100000:3.0:1769074957.188691:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xba:0x0] (0->157) req@ffff91615e544000 x1855007616301312/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.188702:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544000 with x1855007616301312 ext(0->157) 00002000:00010000:3.0:1769074957.188708:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544000 00000100:00100000:3.0:1769074957.188722:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301568 00000100:00100000:3.0:1769074957.188725:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301568 00002000:00100000:3.0:1769074957.188739:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xcf:0x0] (0->157) req@ffff91615e546680 x1855007616301568/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.188747:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546680 with x1855007616301568 ext(0->157) 00002000:00010000:3.0:1769074957.188751:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546680 00000100:00100000:3.0:1769074957.188758:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616301824 00000100:00100000:3.0:1769074957.188760:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616301824 00002000:00100000:3.0:1769074957.188773:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (0->157) req@ffff91615e547b80 x1855007616301824/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.188781:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547b80 with x1855007616301824 ext(0->157) 00002000:00010000:3.0:1769074957.188785:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547b80 00000100:00100000:3.0:1769074957.188791:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302080 00000100:00100000:3.0:1769074957.188794:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302080 00002000:00100000:3.0:1769074957.188806:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (0->157) req@ffff91615e544380 x1855007616302080/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.188819:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544380 with x1855007616302080 ext(0->157) 00002000:00010000:3.0:1769074957.188823:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544380 00000100:00100000:3.0:1769074957.188829:0:20239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302336 00000100:00100000:3.0:1769074957.188832:0:20239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302336 00002000:00100000:3.0:1769074957.188844:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xcc:0x0] (0->157) req@ffff91615e545f80 x1855007616302336/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.188851:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e545f80 with x1855007616302336 ext(0->157) 00002000:00010000:3.0:1769074957.188854:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e545f80 00000100:00100000:3.0:1769074957.188864:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 928 00000100:00100000:3.0:1769074957.188870:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+303:2417:x1855007616301312:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.189462:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2417:x1855007616301440:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2251us (3531us total) trans 4294967992 rc 0/0 00000100:00100000:2.0:1769074957.189473:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 924 00002000:00100000:2.0:1769074957.189482:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xe0:0x0] (0->157) req@ffff91617f920700 x1855007616301440/t4294967992(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.189491:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920700 with x1855007616301440 ext(0->157) 00002000:00010000:2.0:1769074957.189495:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f920700 00000100:00100000:2.0:1769074957.189521:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 929 00000100:00100000:2.0:1769074957.189543:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:2417:x1855007616301568:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.190180:0:44560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 930 00000100:00100000:0.0:1769074957.190191:0:44560:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2417:x1855007616301824:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.190520:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+307:2417:x1855007616301952:12345-192.168.204.32@tcp:4:cp.0 Request processed in 2789us (4517us total) trans 4294967977 rc 0/0 00000100:00100000:1.0:1769074957.190546:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 926 00002000:00100000:1.0:1769074957.190555:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd0:0x0] (0->157) req@ffff91615e544700 x1855007616301952/t4294967977(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.190564:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544700 with x1855007616301952 ext(0->157) 00002000:00010000:1.0:1769074957.190570:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544700 00000100:00100000:1.0:1769074957.190589:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 931 00000100:00100000:1.0:1769074957.190597:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+306:2417:x1855007616302080:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:1.0:1769074957.191284:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+310:2417:x1855007616302208:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3357us (5259us total) trans 4294967994 rc 0/0 00000100:00100000:1.0:1769074957.191292:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 927 00002000:00100000:1.0:1769074957.191300:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xbb:0x0] (0->157) req@ffff91615e546d80 x1855007616302208/t4294967994(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.191308:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546d80 with x1855007616302208 ext(0->157) 00002000:00010000:1.0:1769074957.191312:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546d80 00000100:00100000:1.0:1769074957.191330:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 932 00000100:00100000:1.0:1769074957.191337:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+309:2417:x1855007616302336:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.192433:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+308:2417:x1855007616301184:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5536us (6530us total) trans 4294967979 rc 0/0 00000100:00100000:0.0:1769074957.192444:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 923 00002000:00100000:0.0:1769074957.192453:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xd2:0x0] (0->157) req@ffff91617f920e00 x1855007616301184/t4294967979(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.192470:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f920e00 with x1855007616301184 ext(0->157) 00002000:00010000:0.0:1769074957.192475:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617f920e00 00000100:00100000:2.0:1769074957.192832:0:41795:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617f923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+311:2417:x1855007616300928:12345-192.168.204.32@tcp:4:cp.0 Request processed in 6394us (7051us total) trans 4294967991 rc 0/0 00000100:00100000:2.0:1769074957.192841:0:41795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 922 00002000:00100000:2.0:1769074957.192847:0:41795:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xc6:0x0] (0->157) req@ffff91617f923b80 x1855007616300928/t4294967991(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.192855:0:41795:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617f923b80 with x1855007616300928 ext(0->157) 00002000:00010000:2.0:1769074957.192860:0:41795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91617f923b80 00000100:00100000:3.0:1769074957.193626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.193653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.193667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.193681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074957.193722:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302592 00000100:00100000:3.0:1769074957.193729:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302592 00002000:00100000:3.0:1769074957.193763:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xd3:0x0] (0->157) req@ffff91615e544a80 x1855007616302592/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.193773:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544a80 with x1855007616302592 ext(0->157) 00002000:00010000:3.0:1769074957.193777:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e544a80 00000100:00100000:3.0:1769074957.193789:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302464 00000100:00100000:3.0:1769074957.193791:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302464 00002000:00100000:3.0:1769074957.193830:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xe3:0x0] (0->157) req@ffff91615e546a00 x1855007616302464/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.193837:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546a00 with x1855007616302464 ext(0->157) 00002000:00010000:3.0:1769074957.193842:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546a00 00000100:00100000:3.0:1769074957.193850:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302720 00000100:00100000:3.0:1769074957.193852:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302720 00002000:00100000:3.0:1769074957.193865:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xe2:0x0] (0->157) req@ffff91615e545880 x1855007616302720/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.193872:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e545880 with x1855007616302720 ext(0->157) 00002000:00010000:3.0:1769074957.193876:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e545880 00000100:00100000:3.0:1769074957.193882:0:41468:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302848 00000100:00100000:3.0:1769074957.193884:0:41468:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302848 00002000:00100000:3.0:1769074957.193896:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (0->157) req@ffff91615e547800 x1855007616302848/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.193903:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547800 with x1855007616302848 ext(0->157) 00002000:00010000:3.0:1769074957.193907:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547800 00000100:00100000:3.0:1769074957.193917:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 933 00000100:00100000:3.0:1769074957.193925:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2418:x1855007616302592:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.194287:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+311:2417:x1855007616301312:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5416us (5765us total) trans 4294967981 rc 0/0 00000100:00100000:3.0:1769074957.194295:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 928 00002000:00100000:3.0:1769074957.194301:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0xba:0x0] (0->157) req@ffff91615e544000 x1855007616301312/t4294967981(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.194308:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544000 with x1855007616301312 ext(0->157) 00002000:00010000:3.0:1769074957.194312:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544000 00000100:00100000:3.0:1769074957.194331:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 934 00000100:00100000:3.0:1769074957.194338:0:20239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616302464:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:3.0:1769074957.194583:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:2418:x1855007616302592:12345-192.168.204.32@tcp:4:cp.0 Request processed in 657us (968us total) trans 4294967996 rc 0/0 00000100:00100000:3.0:1769074957.194589:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 933 00002000:00100000:3.0:1769074957.194595:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xd3:0x0] (0->157) req@ffff91615e544a80 x1855007616302592/t4294967996(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.194601:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544a80 with x1855007616302592 ext(0->157) 00002000:00010000:3.0:1769074957.194604:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e544a80 00000100:00100000:3.0:1769074957.194630:0:41468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 935 00000100:00100000:3.0:1769074957.194637:0:41468:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+310:2417:x1855007616302720:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.194936:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 936 00000100:00100000:0.0:1769074957.194946:0:26191:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616302848:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:0.0:1769074957.195137:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+315:2417:x1855007616301568:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5609us (6572us total) trans 4294967993 rc 0/0 00000100:00100000:0.0:1769074957.195145:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 929 00002000:00100000:0.0:1769074957.195151:0:8410:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xcf:0x0] (0->157) req@ffff91615e546680 x1855007616301568/t4294967993(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.195159:0:8410:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546680 with x1855007616301568 ext(0->157) 00002000:00010000:0.0:1769074957.195163:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546680 00000100:00100000:1.0:1769074957.196445:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+316:2417:x1855007616301696:12345-192.168.204.32@tcp:4:cp.0 Request processed in 9025us (10495us total) trans 4294967978 rc 0/0 00000100:00100000:1.0:1769074957.196456:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 925 00002000:00100000:1.0:1769074957.196465:0:8411:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (0->157) req@ffff91615e547480 x1855007616301696/t4294967978(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.196473:0:8411:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547480 with x1855007616301696 ext(0->157) 00002000:00010000:1.0:1769074957.196479:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547480 00000100:00100000:0.0:1769074957.196883:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616302336:12345-192.168.204.32@tcp:4:cp.0 Request processed in 5544us (8271us total) trans 4294967995 rc 0/0 00000100:00100000:0.0:1769074957.196890:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 932 00002000:00100000:0.0:1769074957.196896:0:8409:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xcc:0x0] (0->157) req@ffff91615e545f80 x1855007616302336/t4294967995(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.196904:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e545f80 with x1855007616302336 ext(0->157) 00002000:00010000:0.0:1769074957.196908:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e545f80 00000100:00100000:3.0:1769074957.197495:0:44560:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+315:2417:x1855007616301824:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7303us (8913us total) trans 4294967980 rc 0/0 00000100:00100000:3.0:1769074957.197504:0:44560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 930 00002000:00100000:3.0:1769074957.197510:0:44560:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0xcb:0x0] (0->157) req@ffff91615e547b80 x1855007616301824/t4294967980(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.197519:0:44560:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547b80 with x1855007616301824 ext(0->157) 00002000:00010000:3.0:1769074957.197523:0:44560:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547b80 00000100:00100000:3.0:1769074957.197924:0:20239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616302464:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3584us (4267us total) trans 4294967997 rc 0/0 00000100:00100000:3.0:1769074957.197931:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 934 00002000:00100000:3.0:1769074957.197937:0:20239:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xe3:0x0] (0->157) req@ffff91615e546a00 x1855007616302464/t4294967997(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1769074957.197951:0:20239:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e546a00 with x1855007616302464 ext(0->157) 00002000:00010000:3.0:1769074957.197956:0:20239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91615e546a00 00000100:00100000:0.0:1769074957.198037:0:41468:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616302720:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3398us (4365us total) trans 4294967982 rc 0/0 00000100:00100000:0.0:1769074957.198047:0:41468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 935 00002000:00100000:0.0:1769074957.198053:0:41468:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0xe2:0x0] (0->157) req@ffff91615e545880 x1855007616302720/t4294967982(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1769074957.198069:0:41468:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e545880 with x1855007616302720 ext(0->157) 00002000:00010000:0.0:1769074957.198076:0:41468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e545880 00000100:00100000:1.0:1769074957.198385:0:26191:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616302848:12345-192.168.204.32@tcp:4:cp.0 Request processed in 3439us (4700us total) trans 4294967983 rc 0/0 00000100:00100000:1.0:1769074957.198392:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 936 00002000:00100000:1.0:1769074957.198398:0:26191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (0->157) req@ffff91615e547800 x1855007616302848/t4294967983(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1769074957.198405:0:26191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e547800 with x1855007616302848 ext(0->157) 00002000:00010000:1.0:1769074957.198409:0:26191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e547800 00000100:00100000:2.0:1769074957.198493:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91615e544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616302080:12345-192.168.204.32@tcp:4:cp.0 Request processed in 7896us (9898us total) trans 4294967984 rc 0/0 00000100:00100000:2.0:1769074957.198503:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 931 00002000:00100000:2.0:1769074957.198508:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xc8:0x0] (0->157) req@ffff91615e544380 x1855007616302080/t4294967984(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.198516:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91615e544380 with x1855007616302080 ext(0->157) 00002000:00010000:2.0:1769074957.198520:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91615e544380 00000100:00100000:0.0:1769074957.206107:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074957.206208:0:44367:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616302976 00000100:00100000:2.0:1769074957.206219:0:44367:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616302976 00002000:00100000:2.0:1769074957.206269:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd4:0x0] (0->157) req@ffff91617735d880 x1855007616302976/t0(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/0 e 0 to 0 dl 1769074968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.206280:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617735d880 with x1855007616302976 ext(0->157) 00002000:00010000:2.0:1769074957.206286:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617735d880 00000100:00100000:2.0:1769074957.206321:0:44367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 937 00000100:00100000:2.0:1769074957.206330:0:44367:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+312:2417:x1855007616302976:12345-192.168.204.32@tcp:4:cp.0 00000100:00100000:2.0:1769074957.207720:0:44367:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616302976:12345-192.168.204.32@tcp:4:cp.0 Request processed in 1384us (1614us total) trans 4294967985 rc 0/0 00000100:00100000:2.0:1769074957.207731:0:44367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 937 00002000:00100000:2.0:1769074957.207741:0:44367:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xd4:0x0] (0->157) req@ffff91617735d880 x1855007616302976/t4294967985(0) o4->0e3d52fd-a30d-4263-b65e-2d3fbcbbec40@192.168.204.32@tcp:493/0 lens 648/448 e 0 to 0 dl 1769074968 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1769074957.207750:0:44367:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91617735d880 with x1855007616302976 ext(0->157) 00002000:00010000:2.0:1769074957.207755:0:44367:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91617735d880 00000100:00100000:2.0:1769074957.235794:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1769074957.235819:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626662656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769074957.235891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074957.235978:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662656 00000100:00100000:2.0:1769074957.235987:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662656 00000100:00100000:2.0:1769074957.236032:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1769074957.236040:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626662656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1769074957.236063:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 229376 granted 490899520 pending 1548288 free 3915304960 avail 3683782656 00000100:00100000:2.0:1769074957.236108:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626662656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074957.236115:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1769074957.236167:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626662656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1769074957.236381:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626662784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1769074957.236406:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074957.236476:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662784 00000100:00100000:0.0:1769074957.236481:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662784 00000100:00100000:0.0:1769074957.236514:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1769074957.236521:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916044b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626662784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1769074957.236561:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 200704 granted 490936384 pending 1548288 free 3764092928 avail 3532570624 00000100:00100000:0.0:1769074957.236598:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916044b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626662784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074957.236605:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1769074957.236688:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626662784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1769074957.492659:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1769074958.517990:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769074959.541020:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1769074960.082301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1769074960.082364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1769074960.082482:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303232 00000100:00100000:1.0:1769074960.082493:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303232 00000100:00100000:1.0:1769074960.082633:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3206 00000100:00100000:1.0:1769074960.082646:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616303232:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074960.082726:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2418:x1855007616303232:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 84us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074960.082735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3206 00000100:00100000:0.0:1769074960.082895:0:37104:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303104 00000100:00100000:0.0:1769074960.082901:0:37104:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303104 00000100:00100000:0.0:1769074960.082944:0:37104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 287 00000100:00100000:0.0:1769074960.082952:0:37104:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618163bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616303104:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074960.082982:0:37104:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618163bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2418:x1855007616303104:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 31us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074960.082989:0:37104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 287 00000100:00080000:3.0:1769074960.083212:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1769074960.089599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074960.089645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074960.089666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074960.089701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074960.089720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1769074960.089812:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303744 00000100:00100000:2.0:1769074960.089822:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303744 00000100:00100000:2.0:1769074960.089883:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303360 00000100:00100000:2.0:1769074960.089887:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303360 00000100:00100000:2.0:1769074960.089903:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303872 00000100:00100000:2.0:1769074960.089905:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303872 00000100:00100000:2.0:1769074960.089926:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3207 00000100:00100000:2.0:1769074960.089934:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616303744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074960.090006:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2417:x1855007616303744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074960.090013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3207 00000100:00100000:2.0:1769074960.090031:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3208 00000100:00100000:2.0:1769074960.090037:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2417:x1855007616303360:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074960.090074:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2417:x1855007616303360:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074960.090084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3208 00000100:00100000:2.0:1769074960.090096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3209 00000100:00100000:2.0:1769074960.090102:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2417:x1855007616303872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074960.090123:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2417:x1855007616303872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074960.090129:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3209 00000100:00100000:3.0:1769074960.090355:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303488 00000100:00100000:3.0:1769074960.090359:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303488 00000100:00100000:3.0:1769074960.090397:0:8625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616303616 00000100:00100000:3.0:1769074960.090401:0:8625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616303616 00000100:00100000:3.0:1769074960.090420:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2132 00000100:00100000:3.0:1769074960.090427:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616303488:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1769074960.090456:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+314:2417:x1855007616303488:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 29us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074960.090462:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2132 00000100:00100000:3.0:1769074960.090474:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2133 00000100:00100000:3.0:1769074960.090480:0:8625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616303616:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1769074960.090500:0:8625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+313:2417:x1855007616303616:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 20us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074960.090506:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2133 00000100:00080000:0.0:1769074960.090944:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1769074960.090949:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1769074960.090952:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1769074960.090955:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1769074960.307869:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1769074960.307888:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626662912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1769074960.307947:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074960.308074:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626662912 00000100:00100000:2.0:1769074960.308080:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626662912 00000100:00100000:2.0:1769074960.308138:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1769074960.308144:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626662912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1769074960.308175:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 200704 granted 490936384 pending 1548288 free 3763871744 avail 3532349440 00000100:00100000:2.0:1769074960.308212:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626662912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074960.308216:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1769074960.308258:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626662912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1769074960.308398:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1769074960.564405:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1769074961.587968:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074961.843874:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1769074961.843895:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626663040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074961.843961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074961.844291:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1769074961.844302:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626663168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1769074961.844338:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074961.844635:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663168 00000100:00100000:2.0:1769074961.844645:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663168 00000100:00100000:2.0:1769074961.844717:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1769074961.844726:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626663168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1769074961.844757:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 229376 granted 490899520 pending 1548288 free 3915083776 avail 3683561472 00000100:00100000:2.0:1769074961.844812:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1855007626663168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.844819:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1769074961.844869:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1855007626663168:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1769074961.845022:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1769074961.846150:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663040 00000100:00100000:3.0:1769074961.846162:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663040 00000100:00100000:3.0:1769074961.846220:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1769074961.846230:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626663040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1769074961.846265:0:8415:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1444261888 avail 1298022400 00000100:00100000:3.0:1769074961.846331:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1855007626663040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1769074961.846338:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1769074961.846482:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626663680:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846518:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846584:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664192:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846627:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1769074961.846632:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626663296:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846658:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846679:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626663808:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846713:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664320:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846753:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1855007626663552:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.846772:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.846784:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626664064:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.847037:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664192 00000100:00100000:1.0:1769074961.847043:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664192 00000100:00100000:1.0:1769074961.847071:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1769074961.847078:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.847182:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663296 00000100:00100000:2.0:1769074961.847186:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663296 00000100:00100000:2.0:1769074961.847226:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1769074961.847232:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91618163a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626663296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.847326:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626663424:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.847653:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664192:12345-0@lo:400:kworker.0 Request processed in 574us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.847660:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1769074961.847687:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663680 00000100:00100000:1.0:1769074961.847692:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663680 00000100:00100000:1.0:1769074961.847729:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663808 00000100:00100000:1.0:1769074961.847731:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663808 00000100:00100000:1.0:1769074961.847748:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663552 00000100:00100000:1.0:1769074961.847751:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663552 00000100:00100000:1.0:1769074961.848411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1769074961.848422:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626663680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.848470:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604359dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1855007626663680:12345-0@lo:400:kworker.0 Request processed in 51us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.848477:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1769074961.848490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1769074961.848497:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626663808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.848524:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1855007626663808:12345-0@lo:400:kworker.0 Request processed in 29us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.848561:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1769074961.848574:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1769074961.848581:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1855007626663552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.848609:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1855007626663552:12345-0@lo:400:kworker.0 Request processed in 29us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.848614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00080000:1.0:1769074961.848650:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1769074961.848655:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074961.848693:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664320 00000100:00100000:1.0:1769074961.848699:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664320 00000100:00100000:1.0:1769074961.848732:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:1.0:1769074961.848739:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.849490:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664320:12345-0@lo:400:kworker.0 Request processed in 749us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.849499:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00080000:1.0:1769074961.849561:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1769074961.849571:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1769074961.849584:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916044b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626664704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074961.849636:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074961.849674:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664704 00000100:00100000:1.0:1769074961.849679:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664704 00000100:00100000:1.0:1769074961.849702:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1769074961.849709:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b14ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626664704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1769074961.849739:0:8414:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446207488 avail 1299968000 00000100:00100000:1.0:1769074961.849999:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b14ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1855007626664704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 290us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074961.850007:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1769074961.850054:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916044b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1855007626664704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1769074961.850106:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1855007626663808:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.850118:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664320:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.850129:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1855007626663680:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.850139:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664192:0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.850810:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91618163a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e86036b9-84bb-449e-baba-8ef95d66b0fb+23:3654:x1855007626663296:12345-0@lo:400:kworker.0 Request processed in 3568us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.850821:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1769074961.851250:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e86036b9-84bb-449e-baba-8ef95d66b0fb:3654:1855007626663296:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.853106:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.853563:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1855007626664576:0@lo:400:kworker.0 00000100:00100000:3.0:1769074961.853619:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1769074961.853686:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1855007626663552:0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.853995:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664576 00000100:00100000:2.0:1769074961.854004:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664576 00000100:00100000:2.0:1769074961.854059:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:2.0:1769074961.854068:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1855007626664576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.854124:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1855007626664576:12345-0@lo:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.854131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:0.0:1769074961.854242:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074961.854272:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626663936:0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.854297:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1769074961.854317:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626664448:0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.854340:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074961.854380:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663424 00000100:00100000:2.0:1769074961.854384:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663424 00000100:00100000:2.0:1769074961.854407:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626663936 00000100:00100000:2.0:1769074961.854410:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626663936 00000100:00100000:2.0:1769074961.854447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:2.0:1769074961.854453:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626663424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.854484:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1855007626663424:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.854490:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:2.0:1769074961.854504:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:2.0:1769074961.854510:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626663936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.854563:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1855007626663936:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.854569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00080000:2.0:1769074961.854593:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1769074961.855876:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1855007626664576:0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.861623:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1855007626663040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1769074961.861666:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1855007626663424:0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.861677:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1855007626663936:0@lo:400:kworker.0 00000100:00100000:1.0:1769074961.864654:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664064 00000100:00100000:1.0:1769074961.864671:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664064 00000100:00100000:1.0:1769074961.864904:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664448 00000100:00100000:1.0:1769074961.864908:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664448 00000100:00080000:0.0:1769074961.864990:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074961.867182:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1769074961.867218:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916041f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626664064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.867323:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916041f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626664064:12345-0@lo:400:kworker.0 Request processed in 128us (14226us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.867331:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1769074961.867350:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1769074961.867356:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626664448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1769074961.867387:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626664448:12345-0@lo:400:kworker.0 Request processed in 31us (13046us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074961.867393:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1769074961.867508:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626664448:0@lo:400:kworker.0 00000100:00100000:0.0:1769074961.867575:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604359e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626664064:0@lo:400:kworker.0 00000100:00100000:1.0:1769074962.356484:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1769074962.356505:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91604b14a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1769074962.356615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074962.356691:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664832 00000100:00100000:1.0:1769074962.356699:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664832 00000100:00100000:1.0:1769074962.356743:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1769074962.356751:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91604b148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1769074962.356773:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 229376 granted 490899520 pending 1548288 free 3915083776 avail 3683561472 00000100:00100000:1.0:1769074962.356898:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91604b148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1855007626664832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074962.356905:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1769074962.356957:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91604b14a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1855007626664832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1769074962.357389:0:3656:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff91617ff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1769074962.357424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1769074962.357912:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626664960 00000100:00100000:1.0:1769074962.357920:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626664960 00000100:00100000:1.0:1769074962.357962:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1769074962.357970:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626664960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1769074962.357990:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 200704 granted 490936384 pending 1548288 free 3763871744 avail 3532349440 00000100:00100000:1.0:1769074962.358034:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1855007626664960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074962.358041:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1769074962.358321:0:3656:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff91617ff7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1855007626664960:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1769074962.360233:0:8401:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967985 is committed 00000001:00080000:0.0:1769074962.365368:0:9473:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967997 is committed 00010000:00010000:0.0:1769074962.611810:0:6506:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1769074963.636405:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1769074964.531932:0:37963:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1769074964.531940:0:37963:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1769074964.532572:0:37963:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1769074964.532582:0:37963:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1769074964.659854:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1769074965.195221:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195330:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195433:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1769074965.195518:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304256 00000100:00100000:0.0:1769074965.195527:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304256 00000100:00100000:0.0:1769074965.195610:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304768 00000100:00100000:0.0:1769074965.195613:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304768 00000100:00100000:0.0:1769074965.195631:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304128 00000100:00100000:0.0:1769074965.195633:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304128 00000100:00100000:0.0:1769074965.195647:0:10046:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304640 00000100:00100000:0.0:1769074965.195650:0:10046:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304640 00000100:00100000:0.0:1769074965.195666:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3216 00000100:00100000:0.0:1769074965.195675:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2419:x1855007616304256:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074965.195768:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+406:2419:x1855007616304256:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 94us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074965.195775:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3216 00000100:00100000:0.0:1769074965.195792:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3217 00000100:00100000:0.0:1769074965.195799:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2419:x1855007616304768:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074965.195823:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+6:2419:x1855007616304768:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074965.195829:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3217 00000100:00100000:0.0:1769074965.195841:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3218 00000100:00100000:0.0:1769074965.195847:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2419:x1855007616304128:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074965.195871:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+35:2419:x1855007616304128:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074965.195876:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3218 00000100:00100000:0.0:1769074965.195887:0:10046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3219 00000100:00100000:0.0:1769074965.195893:0:10046:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2419:x1855007616304640:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1769074965.195914:0:10046:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55248ee8-1097-44b2-9a8f-4dfaa937cd5d+39:2419:x1855007616304640:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 22us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1769074965.195921:0:10046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3219 00000100:00080000:0.0:1769074965.195936:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1769074965.195940:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1769074965.196143:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304512 00000100:00100000:1.0:1769074965.196149:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304512 00000100:00100000:1.0:1769074965.196189:0:24564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304384 00000100:00100000:1.0:1769074965.196192:0:24564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304384 00000100:00100000:1.0:1769074965.196216:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2137 00000100:00100000:1.0:1769074965.196223:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2419:x1855007616304512:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074965.196252:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff91617ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+205:2419:x1855007616304512:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 30us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074965.196257:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2137 00000100:00100000:1.0:1769074965.196268:0:24564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2138 00000100:00100000:1.0:1769074965.196273:0:24564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2419:x1855007616304384:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1769074965.196296:0:24564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0e3d52fd-a30d-4263-b65e-2d3fbcbbec40+206:2419:x1855007616304384:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1769074965.196301:0:24564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2138 00000100:00080000:0.0:1769074965.196645:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1769074965.196649:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1769074965.201608:0:37105:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007616304000 00000100:00100000:2.0:1769074965.201624:0:37105:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007616304000 00000100:00100000:2.0:1769074965.201773:0:37105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 289 00000100:00100000:2.0:1769074965.201784:0:37105:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916181639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2419:x1855007616304000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1769074965.201877:0:37105:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916181639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c913fc96-1499-4a5b-8723-2b5b0deb123f+12:2419:x1855007616304000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 95us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074965.201884:0:37105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 289 00000040:00080000:1.0:1769074965.427912:0:38012:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1769074965.427922:0:38012:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1769074965.429360:0:38012:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1769074965.429386:0:38012:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1769074965.430711:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff916041f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626665088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1769074965.430778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1769074965.431016:0:9519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1855007626665088 00000100:00100000:2.0:1769074965.431024:0:9519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1855007626665088 00000100:00100000:2.0:1769074965.431083:0:9519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1769074965.431091:0:9519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff916043582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626665088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1769074965.431118:0:9519:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 200704 granted 489388096 pending 0 free 3763871744 avail 3532349440 00000100:00100000:2.0:1769074965.431169:0:9519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff916043582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1855007626665088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1769074965.431177:0:9519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1769074965.431268:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff916041f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1855007626665088:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1769074965.431285:0:6514:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1769074965.683875:0:36674:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 64460 lines, 64460 kept, 0 dropped, 0 bad.